[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:06 dist-test-slave-2kcd krb5kdc[13922](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:06 dist-test-slave-2kcd krb5kdc[13922](info): set up 2 sockets
Aug 06 20:31:06 dist-test-slave-2kcd krb5kdc[13922](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 20:31:07.455157 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.434s user 0.003s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:07 dist-test-slave-2kcd krb5kdc[13922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:07.648979 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:45093
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:45093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:07.980585 13942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:07.980978 13942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:07.981145 13942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:07.988925 13942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:07.989051 13942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:07.989149 13942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:07.989250 13942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:07.989333 13942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:07.999455 13942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:45093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:45093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:08.000867 13942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:08.002225 13942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:08.014618 13955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:08.014699 13958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:08.015203 13942 server_base.cc:1034] running on GCE node
W20260806 20:31:08.014652 13954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:08.016074 13942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:08.017554 13942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:08.018788 13942 hybrid_clock.cc:648] HybridClock initialized: now 1786048268018752 us; error 115 us; skew 500 ppm
I20260806 20:31:08.019253 13942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:08 dist-test-slave-2kcd krb5kdc[13922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048268, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:08.027091 13942 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:08.028716 13942 webserver.cc:460] Webserver started at http://127.13.149.126:46255/ using document root <none> and password file <none>
I20260806 20:31:08.029464 13942 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:08.029620 13942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:08.029942 13942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:08.033106 13942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "fcfcc7d660c545ea995fdc029bd787c8"
format_stamp: "Formatted at 2026-08-06 20:31:08 on dist-test-slave-2kcd"
server_key: "c9bf53311e6d36661657c5f2a2cbac2a"
server_key_iv: "cc93370410f4d9da6ea7584fbff83c7a"
server_key_version: "encryptionkey@0"
I20260806 20:31:08.033870 13942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "fcfcc7d660c545ea995fdc029bd787c8"
format_stamp: "Formatted at 2026-08-06 20:31:08 on dist-test-slave-2kcd"
server_key: "c9bf53311e6d36661657c5f2a2cbac2a"
server_key_iv: "cc93370410f4d9da6ea7584fbff83c7a"
server_key_version: "encryptionkey@0"
I20260806 20:31:08.039076 13942 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:31:08.042493 13968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:08.043812 13942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:31:08.044009 13942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "fcfcc7d660c545ea995fdc029bd787c8"
format_stamp: "Formatted at 2026-08-06 20:31:08 on dist-test-slave-2kcd"
server_key: "c9bf53311e6d36661657c5f2a2cbac2a"
server_key_iv: "cc93370410f4d9da6ea7584fbff83c7a"
server_key_version: "encryptionkey@0"
I20260806 20:31:08.044210 13942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:08.081493 13942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:08.086038 13942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:08.086367 13942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:08.107372 13942 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:45093
I20260806 20:31:08.107438 14042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:45093 every 8 connection(s)
I20260806 20:31:08.108873 13942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:08.112728 14043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:08.116684 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 13942
I20260806 20:31:08.117100 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:08.119697 13909 external_mini_cluster.cc:1428] Setting key e395791b34471c4c3c7defd888e18600
I20260806 20:31:08.125451 14043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8: Bootstrap starting.
I20260806 20:31:08.128439 14043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:08.129556 14043 log.cc:824] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:08.132346 14043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8: No bootstrap required, opened a new log
I20260806 20:31:08.141922 14043 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfcc7d660c545ea995fdc029bd787c8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45093 } }
I20260806 20:31:08.142391 14043 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:08.142493 14043 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfcc7d660c545ea995fdc029bd787c8, State: Initialized, Role: FOLLOWER
I20260806 20:31:08.143134 14043 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfcc7d660c545ea995fdc029bd787c8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45093 } }
I20260806 20:31:08.143390 14043 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:08.143563 14043 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:08.143730 14043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:08.146618 14043 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfcc7d660c545ea995fdc029bd787c8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45093 } }
I20260806 20:31:08.147102 14043 leader_election.cc:302] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcfcc7d660c545ea995fdc029bd787c8; no voters:
I20260806 20:31:08.147840 14043 leader_election.cc:288] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:08.148034 14051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:08.150090 14043 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 20:31:08 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:08.155407 14051 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [term 1 LEADER]: Becoming Leader. State: Replica: fcfcc7d660c545ea995fdc029bd787c8, State: Running, Role: LEADER
I20260806 20:31:08.156157 14051 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfcc7d660c545ea995fdc029bd787c8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45093 } }
I20260806 20:31:08.160450 14053 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcfcc7d660c545ea995fdc029bd787c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfcc7d660c545ea995fdc029bd787c8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45093 } } }
I20260806 20:31:08.160964 14053 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:08.160480 14054 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcfcc7d660c545ea995fdc029bd787c8. Latest consensus state: current_term: 1 leader_uuid: "fcfcc7d660c545ea995fdc029bd787c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfcc7d660c545ea995fdc029bd787c8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45093 } } }
I20260806 20:31:08.161516 14054 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:08.168437 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:08.124359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50178 (local address 127.13.149.126:45093)
0806 20:31:08.125298 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:08.125313 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:08.126644 (+ 1331us) server_negotiation.cc:407] Connection header received
0806 20:31:08.137314 (+ 10670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:08.137340 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:08.137802 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:08.138224 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:08.140952 (+ 2728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:08.142887 (+ 1935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:08.144722 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:08.145826 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:08.146019 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:08.154542 (+ 8523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:08.154556 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:08.154579 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:08.154651 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:08.159305 (+ 4654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:08.160550 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:08.160562 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:08.160569 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:08.160881 (+ 312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:08.161718 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:08.161726 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:08.161732 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:08.162633 (+ 901us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:08.163008 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:08.166200 (+ 3192us) server_negotiation.cc:299] Negotiation successful
0806 20:31:08.166716 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":459,"threads_started":1}
W20260806 20:31:08.175028 14075 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:31:08.175143 14075 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:31:08.175290 14076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:08.177560 14076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:08.186792 14076 catalog_manager.cc:1347] Generated new cluster ID: 482d049c27944b4f8595ced26b9e6028
I20260806 20:31:08.186951 14076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:08.200133 14076 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:08.201840 14076 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:08.211551 14076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcfcc7d660c545ea995fdc029bd787c8: Generated new TSK 0
I20260806 20:31:08.212457 14076 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:08.270843 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45093
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:08.610499 14085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:08.610752 14085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:08.610843 14085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:08.617573 14085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:08.617659 14085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:08.617769 14085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:08.626757 14085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45093
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:08.627931 14085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:08.629220 14085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:08.642151 14099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:08.642201 14096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:08.642264 14101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:08.643573 14085 server_base.cc:1034] running on GCE node
I20260806 20:31:08.644073 14085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:08.644932 14085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:08.646123 14085 hybrid_clock.cc:648] HybridClock initialized: now 1786048268646071 us; error 50 us; skew 500 ppm
I20260806 20:31:08.646370 14085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:08 dist-test-slave-2kcd krb5kdc[13922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048268, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:08.649736 14085 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:08.651166 14085 webserver.cc:460] Webserver started at http://127.13.149.65:41473/ using document root <none> and password file <none>
I20260806 20:31:08.651859 14085 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:08.651995 14085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:08.652328 14085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:08.655478 14085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "5356fd8217084b59af2f729443839f5a"
format_stamp: "Formatted at 2026-08-06 20:31:08 on dist-test-slave-2kcd"
server_key: "4cb2b3748ae8cb93a6a13be1b92db56c"
server_key_iv: "62d5ea4bdc58443b5b5823827a30e304"
server_key_version: "encryptionkey@0"
I20260806 20:31:08.656239 14085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "5356fd8217084b59af2f729443839f5a"
format_stamp: "Formatted at 2026-08-06 20:31:08 on dist-test-slave-2kcd"
server_key: "4cb2b3748ae8cb93a6a13be1b92db56c"
server_key_iv: "62d5ea4bdc58443b5b5823827a30e304"
server_key_version: "encryptionkey@0"
I20260806 20:31:08.661263 14085 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 20:31:08.664572 14112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:08.665851 14085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:08.666018 14085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "5356fd8217084b59af2f729443839f5a"
format_stamp: "Formatted at 2026-08-06 20:31:08 on dist-test-slave-2kcd"
server_key: "4cb2b3748ae8cb93a6a13be1b92db56c"
server_key_iv: "62d5ea4bdc58443b5b5823827a30e304"
server_key_version: "encryptionkey@0"
I20260806 20:31:08.666208 14085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:08.685281 14085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:08.689019 14085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:08.689306 14085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:08.690245 14085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:08.691597 14085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:08.691707 14085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:08.691866 14085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:08.691943 14085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:08.727972 14085 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:45601
I20260806 20:31:08.728029 14284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:45601 every 8 connection(s)
I20260806 20:31:08.729364 14085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:08.739590 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14085
I20260806 20:31:08.739840 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:08.740660 13909 external_mini_cluster.cc:1428] Setting key 6698995ea0c2e1b98c8b11cb93079f46
Aug 06 20:31:08 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048268, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:08.749837 14288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:08.732121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:57839 (local address 127.13.149.126:45093)
0806 20:31:08.732624 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:08.732631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:08.733685 (+ 1054us) server_negotiation.cc:407] Connection header received
0806 20:31:08.735484 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:08.735488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:08.735567 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:08.735667 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:08.737234 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:08.737986 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:08.739492 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:08.740148 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:08.740297 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:08.744159 (+ 3862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:08.744164 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:08.744167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:08.744199 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:08.746798 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:08.747527 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:08.747535 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:08.747544 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:08.747662 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:08.748112 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:08.748117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:08.748121 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:08.748396 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:08.748554 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:08.749403 (+ 849us) server_negotiation.cc:299] Negotiation successful
0806 20:31:08.749587 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":235,"threads_started":1}
I20260806 20:31:08.751362 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:08.732701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:45093 (local address 127.13.149.65:57839)
0806 20:31:08.733507 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:08.733557 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:08.735226 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:08.735876 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:08.735884 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:08.736408 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:08.737069 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:08.737090 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:08.738125 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:08.738129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:08.739331 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:08.739343 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:08.740371 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:08.740376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:08.740568 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:08.741271 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:08.741297 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:08.743940 (+ 2643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:08.746953 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:08.746962 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:08.746977 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:08.747397 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:08.747778 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:08.747783 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:08.747786 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:08.747988 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:08.748531 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:08.748538 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:08.748961 (+ 423us) client_negotiation.cc:769] Sending connection context
0806 20:31:08.749294 (+ 333us) client_negotiation.cc:240] Negotiation successful
0806 20:31:08.749886 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":301,"threads_started":1}
I20260806 20:31:08.752945 14285 heartbeater.cc:347] Connected to a master server at 127.13.149.126:45093
I20260806 20:31:08.753258 14285 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:08.753973 14285 heartbeater.cc:511] Master 127.13.149.126:45093 requested a full tablet report, sending...
I20260806 20:31:08.756318 13993 ts_manager.cc:194] Registered new tserver with Master: 5356fd8217084b59af2f729443839f5a (127.13.149.65:45601)
I20260806 20:31:08.757865 13993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:57839
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:08.783824 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45093
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:09.116158 14292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:09.116467 14292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:09.116644 14292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:09.124020 14292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:09.124172 14292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:09.124372 14292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:09.134220 14292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45093
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:09.135489 14292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:09.136842 14292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:09.149989 14300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:09.150092 14301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:09.150367 14303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:09.151113 14292 server_base.cc:1034] running on GCE node
I20260806 20:31:09.151760 14292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:09.152611 14292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:09.153810 14292 hybrid_clock.cc:648] HybridClock initialized: now 1786048269153753 us; error 44 us; skew 500 ppm
I20260806 20:31:09.154125 14292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:09.157449 14292 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:09.158802 14292 webserver.cc:460] Webserver started at http://127.13.149.66:36397/ using document root <none> and password file <none>
I20260806 20:31:09.159447 14292 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:09.159550 14292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:09.159801 14292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:09.162665 14292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "8e325d18e5dd421b8545958b8e7feb54"
format_stamp: "Formatted at 2026-08-06 20:31:09 on dist-test-slave-2kcd"
server_key: "5e02123314454c785b69dae3eeded882"
server_key_iv: "5861497c0d2ad81de9b5a6710323aef7"
server_key_version: "encryptionkey@0"
I20260806 20:31:09.163381 14292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "8e325d18e5dd421b8545958b8e7feb54"
format_stamp: "Formatted at 2026-08-06 20:31:09 on dist-test-slave-2kcd"
server_key: "5e02123314454c785b69dae3eeded882"
server_key_iv: "5861497c0d2ad81de9b5a6710323aef7"
server_key_version: "encryptionkey@0"
I20260806 20:31:09.168452 14292 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:31:09.171916 14313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:09.173341 14292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:09.173533 14292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "8e325d18e5dd421b8545958b8e7feb54"
format_stamp: "Formatted at 2026-08-06 20:31:09 on dist-test-slave-2kcd"
server_key: "5e02123314454c785b69dae3eeded882"
server_key_iv: "5861497c0d2ad81de9b5a6710323aef7"
server_key_version: "encryptionkey@0"
I20260806 20:31:09.173732 14292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:09.185209 14292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:09.189244 14292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:09.189549 14292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:09.190555 14292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:09.191917 14292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:09.191992 14292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:09.192170 14292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:09.192224 14292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:09.226564 14292 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:37795
I20260806 20:31:09.226609 14500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:37795 every 8 connection(s)
I20260806 20:31:09.227909 14292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:09.231241 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14292
I20260806 20:31:09.231482 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:09.232084 13909 external_mini_cluster.cc:1428] Setting key 742838193e6f66527143f0c9c4f4f2a8
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:09.250765 14288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.230714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:39327 (local address 127.13.149.126:45093)
0806 20:31:09.230978 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:09.230985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:09.232224 (+ 1239us) server_negotiation.cc:407] Connection header received
0806 20:31:09.234593 (+ 2369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:09.234597 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:09.234677 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:09.234761 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:09.236951 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.237706 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.240180 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.240592 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.240697 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:09.244195 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:09.244204 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:09.244213 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:09.244246 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:09.246837 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.247905 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.247913 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.247917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.248109 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.248652 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.248656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.248658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.249042 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:09.249170 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:09.250229 (+ 1059us) server_negotiation.cc:299] Negotiation successful
0806 20:31:09.250409 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 20:31:09.252306 14503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.231160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:45093 (local address 127.13.149.66:39327)
0806 20:31:09.232035 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:09.232089 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:09.234282 (+ 2193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:09.235036 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:09.235048 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:09.235849 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:09.236722 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:09.236749 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.237863 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.237871 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:09.240008 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:09.240033 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.240851 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.240860 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:09.241091 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:09.241800 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:09.241823 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:09.243971 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:09.247019 (+ 3048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:09.247031 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:09.247050 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:09.247757 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:09.248240 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:09.248245 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:09.248249 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:09.248523 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:09.249192 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:09.249204 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:09.249734 (+ 530us) client_negotiation.cc:769] Sending connection context
0806 20:31:09.250096 (+ 362us) client_negotiation.cc:240] Negotiation successful
0806 20:31:09.250705 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":377,"threads_started":1}
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
I20260806 20:31:09.253844 14501 heartbeater.cc:347] Connected to a master server at 127.13.149.126:45093
I20260806 20:31:09.254204 14501 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:09.255142 14501 heartbeater.cc:511] Master 127.13.149.126:45093 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
I20260806 20:31:09.256986 13993 ts_manager.cc:194] Registered new tserver with Master: 8e325d18e5dd421b8545958b8e7feb54 (127.13.149.66:37795)
I20260806 20:31:09.257812 13993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:39327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:09.279389 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45093
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:09.611930 14507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:09.612262 14507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:09.612439 14507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:09.619891 14507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:09.620051 14507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:09.620237 14507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:09.630910 14507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45093
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:09.632378 14507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:09.633894 14507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:09.648284 14515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:09.648411 14517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:09.648633 14519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:09.649534 14507 server_base.cc:1034] running on GCE node
I20260806 20:31:09.650137 14507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:09.651160 14507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:09.652427 14507 hybrid_clock.cc:648] HybridClock initialized: now 1786048269652362 us; error 80 us; skew 500 ppm
I20260806 20:31:09.652881 14507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:09.656380 14507 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:09.657991 14507 webserver.cc:460] Webserver started at http://127.13.149.67:40801/ using document root <none> and password file <none>
I20260806 20:31:09.658713 14507 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:09.658874 14507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:09.659219 14507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:09.662320 14507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "cf8e63a0129e478a8e00f31c4acb8e7d"
format_stamp: "Formatted at 2026-08-06 20:31:09 on dist-test-slave-2kcd"
server_key: "d986273514fad3abd775c3eaaab6106f"
server_key_iv: "2794967c57acec0ccc23b9c49068e710"
server_key_version: "encryptionkey@0"
I20260806 20:31:09.663122 14507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "cf8e63a0129e478a8e00f31c4acb8e7d"
format_stamp: "Formatted at 2026-08-06 20:31:09 on dist-test-slave-2kcd"
server_key: "d986273514fad3abd775c3eaaab6106f"
server_key_iv: "2794967c57acec0ccc23b9c49068e710"
server_key_version: "encryptionkey@0"
I20260806 20:31:09.668385 14507 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:31:09.672245 14529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:09.673797 14507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 20:31:09.674000 14507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "cf8e63a0129e478a8e00f31c4acb8e7d"
format_stamp: "Formatted at 2026-08-06 20:31:09 on dist-test-slave-2kcd"
server_key: "d986273514fad3abd775c3eaaab6106f"
server_key_iv: "2794967c57acec0ccc23b9c49068e710"
server_key_version: "encryptionkey@0"
I20260806 20:31:09.674175 14507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:09.693569 14507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:09.698009 14507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:09.698350 14507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:09.699393 14507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:09.700874 14507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:09.700959 14507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:09.701144 14507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:09.701198 14507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:09.737074 14507 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:38647
I20260806 20:31:09.737106 14691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:38647 every 8 connection(s)
I20260806 20:31:09.738358 14507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:09.747450 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14507
I20260806 20:31:09.747690 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:09.748129 13909 external_mini_cluster.cc:1428] Setting key f3ac0d1f3ed0f981fd5fe9c0809c3a45
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:09.760385 14288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.741101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44081 (local address 127.13.149.126:45093)
0806 20:31:09.741297 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:09.741303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:09.742789 (+ 1486us) server_negotiation.cc:407] Connection header received
0806 20:31:09.744662 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:09.744668 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:09.744772 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:09.744941 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:09.746403 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.747311 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.749506 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.750115 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.750260 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:09.754382 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:09.754387 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:09.754391 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:09.754423 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:09.757340 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.758062 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.758069 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.758077 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.758202 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.758635 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.758640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.758645 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.758918 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:09.759076 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:09.759798 (+ 722us) server_negotiation.cc:299] Negotiation successful
0806 20:31:09.760023 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:31:09.760771 14285 heartbeater.cc:503] Master 127.13.149.126:45093 was elected leader, sending a full tablet report...
I20260806 20:31:09.761543 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.741595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:45093 (local address 127.13.149.67:44081)
0806 20:31:09.742565 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:09.742642 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:09.744360 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:09.745178 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:09.745186 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:09.745675 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:09.746230 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:09.746246 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.747506 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.747510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:09.749358 (+ 1848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:09.749373 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.750432 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.750442 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:09.750751 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:09.751562 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:09.751613 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:09.754168 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:09.757483 (+ 3315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:09.757492 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:09.757507 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:09.757928 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:09.758317 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:09.758322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:09.758326 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:09.758513 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:09.759049 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:09.759057 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:09.759379 (+ 322us) client_negotiation.cc:769] Sending connection context
0806 20:31:09.759691 (+ 312us) client_negotiation.cc:240] Negotiation successful
0806 20:31:09.760209 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":397,"threads_started":1}
I20260806 20:31:09.763162 14692 heartbeater.cc:347] Connected to a master server at 127.13.149.126:45093
I20260806 20:31:09.763477 14692 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:09.764430 14692 heartbeater.cc:511] Master 127.13.149.126:45093 requested a full tablet report, sending...
I20260806 20:31:09.765914 13992 ts_manager.cc:194] Registered new tserver with Master: cf8e63a0129e478a8e00f31c4acb8e7d (127.13.149.67:38647)
I20260806 20:31:09.766800 13992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:44081
I20260806 20:31:09.776912 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:09.825932 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.810636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46780 (local address 127.13.149.65:45601)
0806 20:31:09.811512 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:09.811520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:09.811548 (+ 28us) server_negotiation.cc:407] Connection header received
0806 20:31:09.811614 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:09.811621 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:09.811836 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:09.811972 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:09.813514 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.814566 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.815768 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.816327 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.816425 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:09.820369 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:09.820380 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:09.820394 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:09.820444 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:09.823402 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.824003 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.824010 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.824012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.824137 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.824458 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.824461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.824463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.824847 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:09.825080 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:09.825339 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 20:31:09.825542 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":565,"threads_started":1}
W20260806 20:31:09.827167 14152 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46780
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 20:31:09 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:09.873443 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.860090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46796 (local address 127.13.149.65:45601)
0806 20:31:09.860267 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:09.860272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:09.860524 (+ 252us) server_negotiation.cc:407] Connection header received
0806 20:31:09.860665 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:09.860669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:09.860767 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:09.860919 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:09.862260 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.862968 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.864137 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.864564 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.864651 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:09.868526 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:09.868531 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:09.868534 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:09.868575 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:09.871355 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.871918 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.871922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.871924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.872041 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.872332 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.872335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.872337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.872574 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:09.872745 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:09.873047 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 20:31:09.873203 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 20:31:09.874985 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14085
I20260806 20:31:09.887502 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.876024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46806 (local address 127.13.149.65:45601)
0806 20:31:09.876179 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:09.876183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:09.876543 (+ 360us) server_negotiation.cc:407] Connection header received
0806 20:31:09.876635 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:09.876638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:09.876689 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:09.876765 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:09.878011 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.878809 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.880111 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:09.880521 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:09.880613 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:09.882904 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:09.882909 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:09.882913 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:09.882940 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:09.885404 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.885993 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.885997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.885999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.886137 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:09.886433 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:09.886436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:09.886438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:09.886672 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:09.886839 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:09.887091 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 20:31:09.887238 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:31:09.888305 14279 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:09.971832 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14085
I20260806 20:31:09.996002 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14292
Aug 06 20:31:10 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:10.011602 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:09.997018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37348 (local address 127.13.149.66:37795)
0806 20:31:09.997599 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:09.997606 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:09.997632 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:31:09.997695 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:09.997701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:09.997912 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:09.998063 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:09.999203 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:10.000257 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:10.001500 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:10.002045 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:10.002151 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:10.006249 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:10.006261 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:10.006276 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:10.006309 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:10.009119 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:10.009741 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:10.009748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:10.009751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:10.009862 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:10.010196 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:10.010200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:10.010202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:10.010524 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:10.010752 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:10.011017 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 20:31:10.011249 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":307,"threads_started":1}
I20260806 20:31:10.013077 14494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:10.096163 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14292
I20260806 20:31:10.122049 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14507
Aug 06 20:31:10 dist-test-slave-2kcd krb5kdc[13922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:10.137915 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:10.123104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44982 (local address 127.13.149.67:38647)
0806 20:31:10.123819 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:10.123826 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:10.123857 (+ 31us) server_negotiation.cc:407] Connection header received
0806 20:31:10.123922 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:10.123928 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:10.124138 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:10.124297 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:10.125613 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:10.126708 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:10.127952 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:10.128512 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:10.128698 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:10.132845 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:10.132858 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:10.132871 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:10.132907 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:10.135548 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:10.136147 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:10.136154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:10.136156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:10.136279 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:10.136595 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:10.136598 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:10.136600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:10.136973 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:10.137205 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:10.137440 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 20:31:10.137631 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":392,"threads_started":1}
I20260806 20:31:10.139214 14684 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:10.221848 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14507
I20260806 20:31:10.247380 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 13942
I20260806 20:31:10.248629 14036 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:10.359898 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 13942
2026-08-06T20:31:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4402 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:10 dist-test-slave-2kcd krb5kdc[14722](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:10 dist-test-slave-2kcd krb5kdc[14722](info): set up 2 sockets
Aug 06 20:31:10 dist-test-slave-2kcd krb5kdc[14722](info): commencing operation
krb5kdc: starting...
W20260806 20:31:11.662580 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:11 dist-test-slave-2kcd krb5kdc[14722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:11.854879 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:45307
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:45307
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:12.199000 14741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:12.199306 14741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:12.199397 14741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:12.206471 14741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:12.206568 14741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:12.206619 14741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:12.206676 14741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:12.206719 14741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:12.216293 14741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:45307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:45307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:12.217577 14741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:12.218822 14741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:12.230571 14756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:12.230647 14753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:12.231189 14751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:12.231439 14741 server_base.cc:1034] running on GCE node
I20260806 20:31:12.232221 14741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:12.233716 14741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:12.234959 14741 hybrid_clock.cc:648] HybridClock initialized: now 1786048272234914 us; error 50 us; skew 500 ppm
I20260806 20:31:12.235304 14741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:12 dist-test-slave-2kcd krb5kdc[14722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048272, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:12.238545 14741 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:12.240074 14741 webserver.cc:460] Webserver started at http://127.13.149.126:35737/ using document root <none> and password file <none>
I20260806 20:31:12.240749 14741 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:12.240963 14741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:12.241288 14741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:12.244179 14741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "ce5c4d636e4049b59ad21058c706587e"
format_stamp: "Formatted at 2026-08-06 20:31:12 on dist-test-slave-2kcd"
server_key: "a3a667f3aeb07f5380192baadbb736c7"
server_key_iv: "c5d9bc45f67df31fc49751e3807c2209"
server_key_version: "encryptionkey@0"
I20260806 20:31:12.245020 14741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "ce5c4d636e4049b59ad21058c706587e"
format_stamp: "Formatted at 2026-08-06 20:31:12 on dist-test-slave-2kcd"
server_key: "a3a667f3aeb07f5380192baadbb736c7"
server_key_iv: "c5d9bc45f67df31fc49751e3807c2209"
server_key_version: "encryptionkey@0"
I20260806 20:31:12.250368 14741 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 20:31:12.254417 14772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:12.256135 14741 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260806 20:31:12.256368 14741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "ce5c4d636e4049b59ad21058c706587e"
format_stamp: "Formatted at 2026-08-06 20:31:12 on dist-test-slave-2kcd"
server_key: "a3a667f3aeb07f5380192baadbb736c7"
server_key_iv: "c5d9bc45f67df31fc49751e3807c2209"
server_key_version: "encryptionkey@0"
I20260806 20:31:12.256633 14741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:12.289376 14741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:12.293725 14741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:12.293989 14741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:12.313717 14741 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:45307
I20260806 20:31:12.313747 14851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:45307 every 8 connection(s)
I20260806 20:31:12.315138 14741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:12.318982 14852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:12.323884 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14741
I20260806 20:31:12.324148 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:12.324880 13909 external_mini_cluster.cc:1428] Setting key 898c4dd9849a5579aa330180f19d1ced
I20260806 20:31:12.329991 14852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e: Bootstrap starting.
I20260806 20:31:12.333869 14852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:12.335152 14852 log.cc:824] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:12.338871 14852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e: No bootstrap required, opened a new log
Aug 06 20:31:12 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:12.347342 14852 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5c4d636e4049b59ad21058c706587e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45307 } }
I20260806 20:31:12.347738 14852 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:12.347882 14852 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5c4d636e4049b59ad21058c706587e, State: Initialized, Role: FOLLOWER
I20260806 20:31:12.348569 14852 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5c4d636e4049b59ad21058c706587e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45307 } }
I20260806 20:31:12.348919 14852 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:12.349104 14852 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:12.349304 14852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:12.349653 14856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:12.326941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59426 (local address 127.13.149.126:45307)
0806 20:31:12.327833 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:12.327844 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:12.327887 (+ 43us) server_negotiation.cc:407] Connection header received
0806 20:31:12.329671 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:12.329694 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:12.330068 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:12.330418 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:12.332329 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:12.333690 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:12.335465 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:12.336581 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:12.336720 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:12.341590 (+ 4870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:12.341597 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:12.341614 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:12.341664 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:12.345190 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:12.345883 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:12.345893 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:12.345909 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:12.346088 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:12.346482 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:12.346489 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:12.346497 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:12.347057 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:12.347355 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:12.347907 (+ 552us) server_negotiation.cc:299] Negotiation successful
0806 20:31:12.348390 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":390,"threads_started":1}
I20260806 20:31:12.351723 14852 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5c4d636e4049b59ad21058c706587e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45307 } }
I20260806 20:31:12.352258 14852 leader_election.cc:302] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce5c4d636e4049b59ad21058c706587e; no voters:
I20260806 20:31:12.352964 14852 leader_election.cc:288] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:12.353077 14858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:12.353811 14858 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [term 1 LEADER]: Becoming Leader. State: Replica: ce5c4d636e4049b59ad21058c706587e, State: Running, Role: LEADER
I20260806 20:31:12.354342 14858 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5c4d636e4049b59ad21058c706587e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45307 } }
I20260806 20:31:12.355075 14852 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:12.357476 14859 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce5c4d636e4049b59ad21058c706587e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5c4d636e4049b59ad21058c706587e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45307 } } }
I20260806 20:31:12.357914 14859 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:12.358673 14860 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce5c4d636e4049b59ad21058c706587e. Latest consensus state: current_term: 1 leader_uuid: "ce5c4d636e4049b59ad21058c706587e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5c4d636e4049b59ad21058c706587e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45307 } } }
I20260806 20:31:12.358978 14860 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:12.359860 14866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:12.365056 14866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:12.375782 14866 catalog_manager.cc:1347] Generated new cluster ID: 1badb4b7ba7c4529b7b60f7fabafafb1
I20260806 20:31:12.375914 14866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:12.398906 14866 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:12.400969 14866 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:12.411907 14866 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce5c4d636e4049b59ad21058c706587e: Generated new TSK 0
I20260806 20:31:12.413033 14866 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:12.462092 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45307
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:12.794596 14888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:12.794884 14888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:12.795074 14888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:12.802415 14888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:12.802544 14888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:12.802743 14888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:12.812206 14888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45307
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:12.813509 14888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:12.814895 14888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:12.828233 14899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:12.828428 14905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:12.828860 14900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:12.829445 14888 server_base.cc:1034] running on GCE node
I20260806 20:31:12.830066 14888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:12.830935 14888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:12.832134 14888 hybrid_clock.cc:648] HybridClock initialized: now 1786048272832082 us; error 52 us; skew 500 ppm
I20260806 20:31:12.832453 14888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:12 dist-test-slave-2kcd krb5kdc[14722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048272, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:12.835763 14888 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:12.837374 14888 webserver.cc:460] Webserver started at http://127.13.149.65:45415/ using document root <none> and password file <none>
I20260806 20:31:12.838017 14888 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:12.838124 14888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:12.838393 14888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:12.841342 14888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "b27a42e566af43d9acc75b386f89029e"
format_stamp: "Formatted at 2026-08-06 20:31:12 on dist-test-slave-2kcd"
server_key: "693367825524046bdb6e24209670430f"
server_key_iv: "2fd2fd85de5170f8836db695ae8283dc"
server_key_version: "encryptionkey@0"
I20260806 20:31:12.842093 14888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "b27a42e566af43d9acc75b386f89029e"
format_stamp: "Formatted at 2026-08-06 20:31:12 on dist-test-slave-2kcd"
server_key: "693367825524046bdb6e24209670430f"
server_key_iv: "2fd2fd85de5170f8836db695ae8283dc"
server_key_version: "encryptionkey@0"
I20260806 20:31:12.847121 14888 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:31:12.850880 14915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:12.852187 14888 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:31:12.852356 14888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "b27a42e566af43d9acc75b386f89029e"
format_stamp: "Formatted at 2026-08-06 20:31:12 on dist-test-slave-2kcd"
server_key: "693367825524046bdb6e24209670430f"
server_key_iv: "2fd2fd85de5170f8836db695ae8283dc"
server_key_version: "encryptionkey@0"
I20260806 20:31:12.852537 14888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:12.881992 14888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:12.886204 14888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:12.886525 14888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:12.887552 14888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:12.888980 14888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:12.889055 14888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:12.889226 14888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:12.889329 14888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:12.922251 14888 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:34797
I20260806 20:31:12.922291 15076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:34797 every 8 connection(s)
I20260806 20:31:12.923600 14888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:12.930450 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14888
I20260806 20:31:12.930703 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:12.931339 13909 external_mini_cluster.cc:1428] Setting key 43194da87f0e2e41f1440e0abc5a6925
Aug 06 20:31:12 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048272, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:12.944051 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:12.926209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:35865 (local address 127.13.149.126:45307)
0806 20:31:12.926661 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:12.926666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:12.927495 (+ 829us) server_negotiation.cc:407] Connection header received
0806 20:31:12.929463 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:12.929469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:12.929562 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:12.929682 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:12.931266 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:12.932197 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:12.933987 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:12.934386 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:12.934534 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:12.938302 (+ 3768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:12.938307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:12.938310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:12.938341 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:12.940971 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:12.941703 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:12.941710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:12.941718 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:12.941833 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:12.942280 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:12.942285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:12.942287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:12.942558 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:12.942715 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:12.943432 (+ 717us) server_negotiation.cc:299] Negotiation successful
0806 20:31:12.943668 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":250,"threads_started":1}
I20260806 20:31:12.945137 15082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:12.926629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:45307 (local address 127.13.149.65:35865)
0806 20:31:12.927324 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:12.927367 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:12.929202 (+ 1835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:12.929910 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:12.929919 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:12.930424 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:12.931099 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:12.931117 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:12.932354 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:12.932358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:12.933824 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:12.933836 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:12.934633 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:12.934643 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:12.934880 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:12.935568 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:12.935590 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:12.938080 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:12.941120 (+ 3040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:12.941128 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:12.941145 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:12.941575 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:12.941944 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:12.941949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:12.941952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:12.942159 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:12.942690 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:12.942697 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:12.943044 (+ 347us) client_negotiation.cc:769] Sending connection context
0806 20:31:12.943304 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 20:31:12.943852 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":289,"threads_started":1}
I20260806 20:31:12.946779 15078 heartbeater.cc:347] Connected to a master server at 127.13.149.126:45307
I20260806 20:31:12.947139 15078 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:12.948086 15078 heartbeater.cc:511] Master 127.13.149.126:45307 requested a full tablet report, sending...
I20260806 20:31:12.950743 14796 ts_manager.cc:194] Registered new tserver with Master: b27a42e566af43d9acc75b386f89029e (127.13.149.65:34797)
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
I20260806 20:31:12.952687 14796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:35865
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:12.979350 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45307
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:13.305226 15085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:13.305647 15085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:13.305851 15085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:13.313189 15085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:13.313288 15085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:13.313453 15085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:13.323076 15085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45307
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:13.324304 15085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:13.325644 15085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:13.338999 15096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:13.339251 15093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:13.339686 15094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:13.339664 15085 server_base.cc:1034] running on GCE node
I20260806 20:31:13.340420 15085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:13.341512 15085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:13.342754 15085 hybrid_clock.cc:648] HybridClock initialized: now 1786048273342711 us; error 33 us; skew 500 ppm
I20260806 20:31:13.343078 15085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:13 dist-test-slave-2kcd krb5kdc[14722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048273, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:13.350910 15085 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:13.352386 15085 webserver.cc:460] Webserver started at http://127.13.149.66:34589/ using document root <none> and password file <none>
I20260806 20:31:13.353230 15085 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:13.353387 15085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:13.353724 15085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:13.357244 15085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "275e5a648fea4fafae0fda53ab439334"
format_stamp: "Formatted at 2026-08-06 20:31:13 on dist-test-slave-2kcd"
server_key: "7b94e4fca932650ffba9399d5a23a43b"
server_key_iv: "42c22c96702adb61385e6ef0fb4120eb"
server_key_version: "encryptionkey@0"
I20260806 20:31:13.358059 15085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "275e5a648fea4fafae0fda53ab439334"
format_stamp: "Formatted at 2026-08-06 20:31:13 on dist-test-slave-2kcd"
server_key: "7b94e4fca932650ffba9399d5a23a43b"
server_key_iv: "42c22c96702adb61385e6ef0fb4120eb"
server_key_version: "encryptionkey@0"
I20260806 20:31:13.363454 15085 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 20:31:13.367133 15114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:13.368439 15085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:31:13.368640 15085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "275e5a648fea4fafae0fda53ab439334"
format_stamp: "Formatted at 2026-08-06 20:31:13 on dist-test-slave-2kcd"
server_key: "7b94e4fca932650ffba9399d5a23a43b"
server_key_iv: "42c22c96702adb61385e6ef0fb4120eb"
server_key_version: "encryptionkey@0"
I20260806 20:31:13.368920 15085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:13.381584 15085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:13.385383 15085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:13.385622 15085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:13.386500 15085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:13.387838 15085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:13.387916 15085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:13.388000 15085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:13.388046 15085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:13.421741 15085 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:45073
I20260806 20:31:13.421783 15297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:45073 every 8 connection(s)
I20260806 20:31:13.423234 15085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:13.427735 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15085
I20260806 20:31:13.427963 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:13.428575 13909 external_mini_cluster.cc:1428] Setting key 51beced683184f25d18313b770098e11
Aug 06 20:31:13 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048273, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:13.447593 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:13.425976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:52527 (local address 127.13.149.126:45307)
0806 20:31:13.426194 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:13.426199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:13.427448 (+ 1249us) server_negotiation.cc:407] Connection header received
0806 20:31:13.430012 (+ 2564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:13.430018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:13.430111 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:13.430226 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:13.432207 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.433014 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.435499 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.435939 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.436049 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:13.440068 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:13.440077 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:13.440085 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:13.440130 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:13.443992 (+ 3862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:13.444747 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:13.444755 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:13.444762 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:13.444963 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:13.445434 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:13.445442 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:13.445448 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:13.445863 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:13.446034 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:13.447121 (+ 1087us) server_negotiation.cc:299] Negotiation successful
0806 20:31:13.447331 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 20:31:13.449204 15301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:13.426455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:45307 (local address 127.13.149.66:52527)
0806 20:31:13.427244 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:13.427319 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:13.429690 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:13.430458 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:13.430466 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:13.431182 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:13.432010 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:13.432039 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.433173 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.433182 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:13.435334 (+ 2152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:13.435358 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.436172 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.436182 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:13.436515 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:13.437293 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:13.437328 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:13.439821 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:13.444145 (+ 4324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:13.444152 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:13.444165 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:13.444616 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:13.445101 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:13.445105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:13.445107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:13.445294 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:13.446152 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:13.446163 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:13.446625 (+ 462us) client_negotiation.cc:769] Sending connection context
0806 20:31:13.446982 (+ 357us) client_negotiation.cc:240] Negotiation successful
0806 20:31:13.447620 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":323,"threads_started":1}
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
I20260806 20:31:13.450841 15298 heartbeater.cc:347] Connected to a master server at 127.13.149.126:45307
I20260806 20:31:13.451200 15298 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:13.452013 15298 heartbeater.cc:511] Master 127.13.149.126:45307 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
I20260806 20:31:13.453701 14796 ts_manager.cc:194] Registered new tserver with Master: 275e5a648fea4fafae0fda53ab439334 (127.13.149.66:45073)
I20260806 20:31:13.454567 14796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:52527
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:13.476346 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45307
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:13.805689 15305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:13.805958 15305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:13.806123 15305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:13.813316 15305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:13.813421 15305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:13.813601 15305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:13.823621 15305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:45307
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:13.825037 15305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:13.826406 15305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:13.840464 15312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:13.840425 15313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:13.840507 15317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:13.841333 15305 server_base.cc:1034] running on GCE node
I20260806 20:31:13.841934 15305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:13.842892 15305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:13.844121 15305 hybrid_clock.cc:648] HybridClock initialized: now 1786048273844064 us; error 54 us; skew 500 ppm
I20260806 20:31:13.844437 15305 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:13 dist-test-slave-2kcd krb5kdc[14722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048273, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:13.847615 15305 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:13.849220 15305 webserver.cc:460] Webserver started at http://127.13.149.67:45757/ using document root <none> and password file <none>
I20260806 20:31:13.849923 15305 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:13.850062 15305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:13.850402 15305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:13.853401 15305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "d720b952f2c0440da0b75d13df422f4b"
format_stamp: "Formatted at 2026-08-06 20:31:13 on dist-test-slave-2kcd"
server_key: "8c4326cd766b80b445aba7f30c05e6e3"
server_key_iv: "9b823e0884f77c02dd8b2061c3d2701d"
server_key_version: "encryptionkey@0"
I20260806 20:31:13.854219 15305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "d720b952f2c0440da0b75d13df422f4b"
format_stamp: "Formatted at 2026-08-06 20:31:13 on dist-test-slave-2kcd"
server_key: "8c4326cd766b80b445aba7f30c05e6e3"
server_key_iv: "9b823e0884f77c02dd8b2061c3d2701d"
server_key_version: "encryptionkey@0"
I20260806 20:31:13.859671 15305 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:31:13.863592 15327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:13.865181 15305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:13.865367 15305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "d720b952f2c0440da0b75d13df422f4b"
format_stamp: "Formatted at 2026-08-06 20:31:13 on dist-test-slave-2kcd"
server_key: "8c4326cd766b80b445aba7f30c05e6e3"
server_key_iv: "9b823e0884f77c02dd8b2061c3d2701d"
server_key_version: "encryptionkey@0"
I20260806 20:31:13.865587 15305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:13.891809 15305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:13.896291 15305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:13.896633 15305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:13.897642 15305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:13.899061 15305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:13.899173 15305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:13.899343 15305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:13.899422 15305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:13.934533 15305 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:34819
I20260806 20:31:13.934585 15501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:34819 every 8 connection(s)
I20260806 20:31:13.935828 15305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:13.945858 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15305
I20260806 20:31:13.946089 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:13.946549 13909 external_mini_cluster.cc:1428] Setting key a6690ce75c41aa9e6f818dd9262fccc9
Aug 06 20:31:13 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048273, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:13.956045 15078 heartbeater.cc:503] Master 127.13.149.126:45307 was elected leader, sending a full tablet report...
I20260806 20:31:13.957181 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:13.938586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:41063 (local address 127.13.149.126:45307)
0806 20:31:13.938779 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:13.938784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:13.939935 (+ 1151us) server_negotiation.cc:407] Connection header received
0806 20:31:13.941986 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:13.941992 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:13.942082 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:13.942195 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:13.943716 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.944476 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.946187 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.946595 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.946733 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:13.950922 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:13.950927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:13.950930 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:13.950961 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:13.953640 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:13.954382 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:13.954386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:13.954389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:13.954529 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:13.955106 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:13.955115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:13.955118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:13.955544 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:13.955671 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:13.956665 (+ 994us) server_negotiation.cc:299] Negotiation successful
0806 20:31:13.956922 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:31:13.958351 15506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:13.939076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:45307 (local address 127.13.149.67:41063)
0806 20:31:13.939768 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:13.939810 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:13.941685 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:13.942450 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:13.942458 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:13.942983 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:13.943544 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:13.943561 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.944627 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.944637 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:13.946041 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:13.946059 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.946987 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.946992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:13.947300 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:13.948022 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:13.948044 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:13.950728 (+ 2684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:13.953762 (+ 3034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:13.953768 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:13.953780 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:13.954211 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:13.954637 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:13.954641 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:13.954643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:13.954820 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:13.955692 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:13.955698 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:13.956182 (+ 484us) client_negotiation.cc:769] Sending connection context
0806 20:31:13.956515 (+ 333us) client_negotiation.cc:240] Negotiation successful
0806 20:31:13.957090 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":290,"threads_started":1}
I20260806 20:31:13.959656 15503 heartbeater.cc:347] Connected to a master server at 127.13.149.126:45307
I20260806 20:31:13.959970 15503 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:13.960743 15503 heartbeater.cc:511] Master 127.13.149.126:45307 requested a full tablet report, sending...
I20260806 20:31:13.962618 14796 ts_manager.cc:194] Registered new tserver with Master: d720b952f2c0440da0b75d13df422f4b (127.13.149.67:34819)
I20260806 20:31:13.963408 14796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:41063
I20260806 20:31:13.974393 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:31:13.993395 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:13.980708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59440 (local address 127.13.149.126:45307)
0806 20:31:13.980929 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:13.980934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:13.981484 (+ 550us) server_negotiation.cc:407] Connection header received
0806 20:31:13.981615 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:13.981619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:13.981698 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:13.981782 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:13.983407 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.984098 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.985445 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:13.985851 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:13.985965 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:13.988271 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:13.988276 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:13.988279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:13.988310 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:13.991058 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:13.991630 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:13.991634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:13.991637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:13.991762 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:13.992116 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:13.992120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:13.992122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:13.992455 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:13.992649 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:13.992978 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 20:31:13.993145 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 20:31:13.999672 14796 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59440:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:14.006716 14796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:14.042069 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.019583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41072 (local address 127.13.149.67:34819)
0806 20:31:14.033111 (+ 13528us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.033125 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.033168 (+ 43us) server_negotiation.cc:407] Connection header received
0806 20:31:14.033288 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.033299 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.033633 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.033870 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:14.035027 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.036691 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.039182 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.040737 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.040896 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.041128 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.041466 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.041660 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13281,"thread_start_us":14935,"threads_started":1}
I20260806 20:31:14.042173 15524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.019247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:34819 (local address 127.0.0.1:41072)
0806 20:31:14.030516 (+ 11269us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:14.030567 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:14.030785 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:14.034285 (+ 3500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:14.034295 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:14.034327 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:14.034767 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.034787 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.036851 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.036858 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.038998 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.039013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.040994 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.041000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.041206 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.041259 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 20:31:14.041404 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 20:31:14.041628 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10926,"mutex_wait_us":4,"thread_start_us":15084,"threads_started":1}
I20260806 20:31:14.043077 15522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.019419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:34797 (local address 127.0.0.1:38774)
0806 20:31:14.034126 (+ 14707us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:14.034146 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:14.034263 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:14.036063 (+ 1800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:14.036068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:14.036098 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:14.036491 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.036502 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.038279 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.038290 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.040227 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.040240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.042251 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.042257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.042445 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.042470 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 20:31:14.042575 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 20:31:14.042708 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14578,"mutex_wait_us":31,"thread_start_us":11199,"threads_started":1}
I20260806 20:31:14.043129 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.020013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.13.149.65:34797)
0806 20:31:14.035267 (+ 15254us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.035277 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.035306 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:31:14.035398 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.035405 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.035654 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.035830 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:14.036679 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.038155 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.040394 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.041721 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.041856 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.042099 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.042618 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.042790 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15071,"thread_start_us":14893,"threads_started":1}
I20260806 20:31:14.044409 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.019984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:45073 (local address 127.0.0.1:41382)
0806 20:31:14.036088 (+ 16104us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:14.036102 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:14.036264 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:14.037162 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:14.037167 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:14.037191 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:14.037623 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.037634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.039558 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.039563 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.041703 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.041717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.043621 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.043627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.043783 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.043816 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 20:31:14.043912 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 20:31:14.044078 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15967,"mutex_wait_us":57,"thread_start_us":15816,"threads_started":1}
I20260806 20:31:14.045202 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.020568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.13.149.66:45073)
0806 20:31:14.035592 (+ 15024us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.035604 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.036217 (+ 613us) server_negotiation.cc:407] Connection header received
0806 20:31:14.036459 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.036465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.036657 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.036902 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:14.037830 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.039389 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.041896 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.043389 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.043534 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.043704 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.043984 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.044820 (+ 836us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14832,"thread_start_us":14704,"threads_started":1}
I20260806 20:31:14.047057 15399 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7557043e2742848ecfe7c111e227c4 (DEFAULT_TABLE table=test-table [id=8113a313a2c2427ab9d94891e3a5ac9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:14.047057 14987 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7557043e2742848ecfe7c111e227c4 (DEFAULT_TABLE table=test-table [id=8113a313a2c2427ab9d94891e3a5ac9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:14.048902 14987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7557043e2742848ecfe7c111e227c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:14.048934 15399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7557043e2742848ecfe7c111e227c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:14.048766 15196 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7557043e2742848ecfe7c111e227c4 (DEFAULT_TABLE table=test-table [id=8113a313a2c2427ab9d94891e3a5ac9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:14.050216 15196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7557043e2742848ecfe7c111e227c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:14.062810 15533 tablet_bootstrap.cc:492] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334: Bootstrap starting.
I20260806 20:31:14.066001 15537 tablet_bootstrap.cc:492] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b: Bootstrap starting.
I20260806 20:31:14.066533 15533 tablet_bootstrap.cc:654] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:14.066629 15534 tablet_bootstrap.cc:492] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e: Bootstrap starting.
I20260806 20:31:14.067938 15533 log.cc:824] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:14.070065 15537 tablet_bootstrap.cc:654] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:14.070322 15534 tablet_bootstrap.cc:654] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:14.071286 15537 log.cc:824] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:14.071556 15534 log.cc:824] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:14.071943 15533 tablet_bootstrap.cc:492] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334: No bootstrap required, opened a new log
I20260806 20:31:14.072301 15533 ts_tablet_manager.cc:1397] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 20:31:14.079535 15534 tablet_bootstrap.cc:492] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e: No bootstrap required, opened a new log
I20260806 20:31:14.079769 15537 tablet_bootstrap.cc:492] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b: No bootstrap required, opened a new log
I20260806 20:31:14.079867 15534 ts_tablet_manager.cc:1397] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260806 20:31:14.080030 15537 ts_tablet_manager.cc:1397] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260806 20:31:14.084662 15533 raft_consensus.cc:348] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.085248 15533 raft_consensus.cc:374] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:14.085373 15533 raft_consensus.cc:729] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 275e5a648fea4fafae0fda53ab439334, State: Initialized, Role: FOLLOWER
I20260806 20:31:14.086228 15533 consensus_queue.cc:260] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.088090 15298 heartbeater.cc:503] Master 127.13.149.126:45307 was elected leader, sending a full tablet report...
I20260806 20:31:14.088886 15533 ts_tablet_manager.cc:1428] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260806 20:31:14.088804 15534 raft_consensus.cc:348] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.089341 15534 raft_consensus.cc:374] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:14.089457 15534 raft_consensus.cc:729] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27a42e566af43d9acc75b386f89029e, State: Initialized, Role: FOLLOWER
I20260806 20:31:14.090142 15534 consensus_queue.cc:260] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.090979 15537 raft_consensus.cc:348] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.091524 15537 raft_consensus.cc:374] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:14.091678 15537 raft_consensus.cc:729] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d720b952f2c0440da0b75d13df422f4b, State: Initialized, Role: FOLLOWER
I20260806 20:31:14.092082 15534 ts_tablet_manager.cc:1428] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e: Time spent starting tablet: real 0.012s user 0.010s sys 0.002s
I20260806 20:31:14.092562 15537 consensus_queue.cc:260] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.093864 15503 heartbeater.cc:503] Master 127.13.149.126:45307 was elected leader, sending a full tablet report...
I20260806 20:31:14.094600 15537 ts_tablet_manager.cc:1428] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260806 20:31:14.153461 15544 raft_consensus.cc:482] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:14.153828 15544 raft_consensus.cc:504] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.156543 15544 leader_election.cc:288] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d720b952f2c0440da0b75d13df422f4b (127.13.149.67:34819), b27a42e566af43d9acc75b386f89029e (127.13.149.65:34797)
I20260806 20:31:14.165504 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.156101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:55755 (local address 127.13.149.67:34819)
0806 20:31:14.156367 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.156376 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.157259 (+ 883us) server_negotiation.cc:407] Connection header received
0806 20:31:14.157518 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.157526 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.157613 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.157663 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:14.158606 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.159758 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.163005 (+ 3247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.164266 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.164447 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.164518 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.165090 (+ 572us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.165229 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 20:31:14.165663 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.156123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:51049 (local address 127.13.149.65:34797)
0806 20:31:14.156342 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.156361 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.157534 (+ 1173us) server_negotiation.cc:407] Connection header received
0806 20:31:14.157630 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.157634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.157705 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.157785 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:14.158623 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.159765 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.163000 (+ 3235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.164266 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.164439 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.164518 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.165090 (+ 572us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.165229 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 20:31:14.165720 15549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.155957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:34797 (local address 127.13.149.66:51049)
0806 20:31:14.157312 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:14.157331 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:14.157451 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:14.157853 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:14.157858 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:14.157947 (+ 89us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:14.158454 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.158465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.159928 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.159933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.162816 (+ 2883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.162829 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.164554 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.164559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.164872 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.164933 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 20:31:14.165028 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 20:31:14.165187 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1224,"mutex_wait_us":239,"spinlock_wait_cycles":22912,"thread_start_us":667,"threads_started":1}
I20260806 20:31:14.165755 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.155923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:34819 (local address 127.13.149.66:55755)
0806 20:31:14.157097 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:14.157121 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:14.157303 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:14.157861 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:14.157864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:14.157899 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:14.158411 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.158428 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.159927 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.159933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.162813 (+ 2880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:14.162829 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.164552 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.164559 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:14.164875 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.164940 (+ 65us) client_negotiation.cc:769] Sending connection context
0806 20:31:14.165028 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 20:31:14.165186 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"mutex_wait_us":345,"thread_start_us":1058,"threads_started":1}
I20260806 20:31:14.167119 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7557043e2742848ecfe7c111e227c4" candidate_uuid: "275e5a648fea4fafae0fda53ab439334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d720b952f2c0440da0b75d13df422f4b" is_pre_election: true
I20260806 20:31:14.167119 15019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7557043e2742848ecfe7c111e227c4" candidate_uuid: "275e5a648fea4fafae0fda53ab439334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27a42e566af43d9acc75b386f89029e" is_pre_election: true
I20260806 20:31:14.167738 15019 raft_consensus.cc:2454] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 275e5a648fea4fafae0fda53ab439334 in term 0.
I20260806 20:31:14.167738 15434 raft_consensus.cc:2454] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 275e5a648fea4fafae0fda53ab439334 in term 0.
I20260806 20:31:14.168609 15117 leader_election.cc:302] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 275e5a648fea4fafae0fda53ab439334, b27a42e566af43d9acc75b386f89029e, d720b952f2c0440da0b75d13df422f4b; no voters:
I20260806 20:31:14.169118 15544 raft_consensus.cc:2781] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:14.169283 15544 raft_consensus.cc:482] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:14.169391 15544 raft_consensus.cc:3037] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:14.171765 15544 raft_consensus.cc:504] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.172508 15544 leader_election.cc:288] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [CANDIDATE]: Term 1 election: Requested vote from peers d720b952f2c0440da0b75d13df422f4b (127.13.149.67:34819), b27a42e566af43d9acc75b386f89029e (127.13.149.65:34797)
I20260806 20:31:14.172950 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7557043e2742848ecfe7c111e227c4" candidate_uuid: "275e5a648fea4fafae0fda53ab439334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d720b952f2c0440da0b75d13df422f4b"
I20260806 20:31:14.173106 15019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7557043e2742848ecfe7c111e227c4" candidate_uuid: "275e5a648fea4fafae0fda53ab439334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27a42e566af43d9acc75b386f89029e"
I20260806 20:31:14.173178 15434 raft_consensus.cc:3037] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:14.173321 15019 raft_consensus.cc:3037] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e [term 0 FOLLOWER]: Advancing to term 1
W20260806 20:31:14.175202 15300 tablet.cc:2369] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:31:14.176046 15080 tablet.cc:2369] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:31:14.176571 15434 raft_consensus.cc:2454] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 275e5a648fea4fafae0fda53ab439334 in term 1.
I20260806 20:31:14.176970 15117 leader_election.cc:302] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 275e5a648fea4fafae0fda53ab439334, d720b952f2c0440da0b75d13df422f4b; no voters:
I20260806 20:31:14.177100 15019 raft_consensus.cc:2454] T 1d7557043e2742848ecfe7c111e227c4 P b27a42e566af43d9acc75b386f89029e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 275e5a648fea4fafae0fda53ab439334 in term 1.
I20260806 20:31:14.177268 15544 raft_consensus.cc:2781] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:14.177793 15544 raft_consensus.cc:686] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [term 1 LEADER]: Becoming Leader. State: Replica: 275e5a648fea4fafae0fda53ab439334, State: Running, Role: LEADER
I20260806 20:31:14.178330 15544 consensus_queue.cc:237] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } }
I20260806 20:31:14.182775 14794 catalog_manager.cc:5495] T 1d7557043e2742848ecfe7c111e227c4 P 275e5a648fea4fafae0fda53ab439334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 275e5a648fea4fafae0fda53ab439334 (127.13.149.66). New cstate: current_term: 1 leader_uuid: "275e5a648fea4fafae0fda53ab439334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d720b952f2c0440da0b75d13df422f4b" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b27a42e566af43d9acc75b386f89029e" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "275e5a648fea4fafae0fda53ab439334" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45073 } health_report { overall_health: HEALTHY } } }
W20260806 20:31:14.187438 15504 tablet.cc:2369] T 1d7557043e2742848ecfe7c111e227c4 P d720b952f2c0440da0b75d13df422f4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:14.232702 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.217172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38782 (local address 127.13.149.65:34797)
0806 20:31:14.217358 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.217363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.217936 (+ 573us) server_negotiation.cc:407] Connection header received
0806 20:31:14.218162 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.218168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.218232 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.218340 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:14.219945 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.220752 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.222075 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.222514 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.222650 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.227056 (+ 4406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:14.227071 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:14.227089 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:14.227122 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:14.229957 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.230624 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.230631 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.230634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.230769 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.231147 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.231152 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.231155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.231518 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:14.231842 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.232122 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.232344 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[14722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048274, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048274, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:14.285936 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.271750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38796 (local address 127.13.149.65:34797)
0806 20:31:14.272013 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.272027 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.272220 (+ 193us) server_negotiation.cc:407] Connection header received
0806 20:31:14.272419 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.272423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.272490 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.272576 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:14.274181 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.274951 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.276230 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.276714 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.276886 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.280773 (+ 3887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:14.280819 (+ 46us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:14.280826 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:14.280868 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:14.283349 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.283944 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.283950 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.283954 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.284086 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.284464 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.284469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.284472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.284739 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:14.285083 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.285325 (+ 242us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.285561 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[14722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:14.336153 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.320858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38808 (local address 127.13.149.65:34797)
0806 20:31:14.321112 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.321119 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.321500 (+ 381us) server_negotiation.cc:407] Connection header received
0806 20:31:14.321675 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.321679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.321744 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.321830 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:14.323506 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.324185 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.325982 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.326399 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.326506 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.330994 (+ 4488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:14.330999 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:14.331002 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:14.331043 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:14.333550 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.334200 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.334205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.334207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.334324 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.334698 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.334704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.334712 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.335012 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:14.335275 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.335580 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.335818 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 20:31:14.338162 14952 tablet_service.cc:2908] Rejecting scan request for tablet 1d7557043e2742848ecfe7c111e227c4: Uninitialized: clean time has not yet been initialized
I20260806 20:31:14.341315 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14888
I20260806 20:31:14.353489 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.342256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38816 (local address 127.13.149.65:34797)
0806 20:31:14.342429 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.342433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.342699 (+ 266us) server_negotiation.cc:407] Connection header received
0806 20:31:14.342845 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.342849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.342924 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.343012 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:14.344129 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.344898 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.346142 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.346649 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.346770 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.348903 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:14.348909 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:14.348912 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:14.348941 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:14.351288 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.351915 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.351919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.351921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.352032 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.352328 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.352331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.352333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.352568 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:14.352770 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.353106 (+ 336us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.353273 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 20:31:14.354172 15071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:14.445613 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14888
I20260806 20:31:14.473644 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15085
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:14.489426 15532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.474548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41388 (local address 127.13.149.66:45073)
0806 20:31:14.474723 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.474727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.474746 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:31:14.474916 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.474920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.474987 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.475080 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:14.476285 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.477110 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.478374 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.478858 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.478991 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.483257 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:14.483273 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:14.483294 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:14.483334 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:14.486461 (+ 3127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.487138 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.487146 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.487148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.487310 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.487651 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.487654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.487656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.487984 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:14.488218 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.488660 (+ 442us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.489082 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 20:31:14.490176 15293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:14.581971 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15085
I20260806 20:31:14.608011 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15305
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[14722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:14.624001 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:14.608921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41074 (local address 127.13.149.67:34819)
0806 20:31:14.609112 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:14.609116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:14.609136 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:31:14.609313 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:14.609316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:14.609384 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:14.609473 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:14.610780 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.611557 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.612991 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:14.613481 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:14.613595 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:14.617842 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:14.617859 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:14.617876 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:14.617924 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:14.620728 (+ 2804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.621578 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.621587 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.621589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.621743 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:14.622306 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:14.622310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:14.622312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:14.622727 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:14.623174 (+ 447us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:14.623344 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 20:31:14.623530 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:31:14.624773 15497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:14.714267 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15305
I20260806 20:31:14.739396 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14741
I20260806 20:31:14.740633 14845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:14.852079 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14741
2026-08-06T20:31:14Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4491 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[15579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[15579](info): set up 2 sockets
Aug 06 20:31:14 dist-test-slave-2kcd krb5kdc[15579](info): commencing operation
krb5kdc: starting...
W20260806 20:31:16.162130 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.002s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:16 dist-test-slave-2kcd krb5kdc[15579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:16.370565 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41817
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:41817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:16.696364 15609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:16.696633 15609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:16.696856 15609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:16.704000 15609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:16.704102 15609 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 20:31:16.704144 15609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:16.704232 15609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:16.704321 15609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:16.704430 15609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:16.714254 15609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:41817
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:16.715524 15609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:16.716883 15609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:16.728976 15616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:16.728922 15620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:16.728917 15617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:16.729840 15609 server_base.cc:1034] running on GCE node
I20260806 20:31:16.730804 15609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:16.732259 15609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:16.733515 15609 hybrid_clock.cc:648] HybridClock initialized: now 1786048276733447 us; error 62 us; skew 500 ppm
I20260806 20:31:16.733886 15609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:16 dist-test-slave-2kcd krb5kdc[15579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048276, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:16.737105 15609 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:16.738461 15609 webserver.cc:460] Webserver started at http://127.13.149.126:43129/ using document root <none> and password file <none>
I20260806 20:31:16.739125 15609 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:16.739213 15609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:16.739509 15609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:16.742435 15609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "876f280121a04469b2b62db669acbcd1"
format_stamp: "Formatted at 2026-08-06 20:31:16 on dist-test-slave-2kcd"
server_key: "e4d627a312855bb91105d9753617d8ec"
server_key_iv: "326d125fc7e84334ff4ec6cd8899e0c2"
server_key_version: "encryptionkey@0"
I20260806 20:31:16.743152 15609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "876f280121a04469b2b62db669acbcd1"
format_stamp: "Formatted at 2026-08-06 20:31:16 on dist-test-slave-2kcd"
server_key: "e4d627a312855bb91105d9753617d8ec"
server_key_iv: "326d125fc7e84334ff4ec6cd8899e0c2"
server_key_version: "encryptionkey@0"
I20260806 20:31:16.748224 15609 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 20:31:16.751575 15629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:16.753005 15609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:16.753185 15609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "876f280121a04469b2b62db669acbcd1"
format_stamp: "Formatted at 2026-08-06 20:31:16 on dist-test-slave-2kcd"
server_key: "e4d627a312855bb91105d9753617d8ec"
server_key_iv: "326d125fc7e84334ff4ec6cd8899e0c2"
server_key_version: "encryptionkey@0"
I20260806 20:31:16.753404 15609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:16.767606 15609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:16.771512 15609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:16.771797 15609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:16.794294 15609 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:41817
I20260806 20:31:16.794327 15732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:41817 every 8 connection(s)
I20260806 20:31:16.795686 15609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:16.797233 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15609
I20260806 20:31:16.797484 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:16.798349 13909 external_mini_cluster.cc:1428] Setting key cefc0d8938af71933b2ff35f1c3df2c6
I20260806 20:31:16.800618 15734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 20:31:16 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:16.813778 15734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1: Bootstrap starting.
I20260806 20:31:16.817852 15734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:16.819082 15734 log.cc:824] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:16.822510 15734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1: No bootstrap required, opened a new log
I20260806 20:31:16.823017 15738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:16.800435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34198 (local address 127.13.149.126:41817)
0806 20:31:16.801290 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:16.801304 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:16.801353 (+ 49us) server_negotiation.cc:407] Connection header received
0806 20:31:16.803524 (+ 2171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:16.803550 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:16.804052 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:16.804489 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:16.805875 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:16.807930 (+ 2055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:16.809234 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:16.810249 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:16.810452 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:16.814419 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:16.814429 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:16.814446 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:16.814487 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:16.818519 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:16.819214 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:16.819223 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:16.819231 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:16.819455 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:16.819943 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:16.819946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:16.819949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:16.820525 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:16.820864 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:16.821255 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 20:31:16.821696 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":442,"threads_started":1}
I20260806 20:31:16.830742 15734 raft_consensus.cc:348] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "876f280121a04469b2b62db669acbcd1" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41817 } }
I20260806 20:31:16.831056 15734 raft_consensus.cc:374] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:16.831130 15734 raft_consensus.cc:729] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876f280121a04469b2b62db669acbcd1, State: Initialized, Role: FOLLOWER
I20260806 20:31:16.831696 15734 consensus_queue.cc:260] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "876f280121a04469b2b62db669acbcd1" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41817 } }
I20260806 20:31:16.832011 15734 raft_consensus.cc:388] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:16.832177 15734 raft_consensus.cc:482] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:16.832374 15734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:16.834498 15734 raft_consensus.cc:504] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "876f280121a04469b2b62db669acbcd1" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41817 } }
I20260806 20:31:16.834982 15734 leader_election.cc:302] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 876f280121a04469b2b62db669acbcd1; no voters:
I20260806 20:31:16.835582 15734 leader_election.cc:288] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:16.835696 15742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:16.836398 15742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [term 1 LEADER]: Becoming Leader. State: Replica: 876f280121a04469b2b62db669acbcd1, State: Running, Role: LEADER
I20260806 20:31:16.837091 15742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "876f280121a04469b2b62db669acbcd1" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41817 } }
I20260806 20:31:16.837797 15734 sys_catalog.cc:564] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:16.840095 15744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "876f280121a04469b2b62db669acbcd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "876f280121a04469b2b62db669acbcd1" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41817 } } }
I20260806 20:31:16.840528 15744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:16.840083 15745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 876f280121a04469b2b62db669acbcd1. Latest consensus state: current_term: 1 leader_uuid: "876f280121a04469b2b62db669acbcd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "876f280121a04469b2b62db669acbcd1" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41817 } } }
I20260806 20:31:16.840919 15745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:16.842764 15759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:16.847941 15759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:16.856333 15759 catalog_manager.cc:1347] Generated new cluster ID: d5d023f12402493ca14b2b758383233a
I20260806 20:31:16.856455 15759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:16.865649 15759 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:16.867399 15759 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:16.881291 15759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1: Generated new TSK 0
I20260806 20:31:16.882241 15759 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:16.945468 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41817
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:17.284201 15779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:17.284538 15779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:17.284718 15779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:17.291942 15779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:17.292085 15779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:17.292238 15779 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:31:17.292382 15779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:17.303529 15779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:41817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:17.305063 15779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:17.306511 15779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:17.319473 15792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:17.319540 15787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:17.319566 15788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:17.320525 15779 server_base.cc:1034] running on GCE node
I20260806 20:31:17.321165 15779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:17.322294 15779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:17.323586 15779 hybrid_clock.cc:648] HybridClock initialized: now 1786048277323500 us; error 60 us; skew 500 ppm
I20260806 20:31:17.323952 15779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:17 dist-test-slave-2kcd krb5kdc[15579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048277, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:17.327149 15779 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:17.328572 15779 webserver.cc:460] Webserver started at http://127.13.149.65:43035/ using document root <none> and password file <none>
I20260806 20:31:17.329283 15779 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:17.329375 15779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:17.329650 15779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:17.332453 15779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "3d26132ae3cb4120ab42dc05268cb9f5"
format_stamp: "Formatted at 2026-08-06 20:31:17 on dist-test-slave-2kcd"
server_key: "9ddb19dbca38424764cb046622b72364"
server_key_iv: "9c4f4019e4a76c21216605e78efdd434"
server_key_version: "encryptionkey@0"
I20260806 20:31:17.333276 15779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "3d26132ae3cb4120ab42dc05268cb9f5"
format_stamp: "Formatted at 2026-08-06 20:31:17 on dist-test-slave-2kcd"
server_key: "9ddb19dbca38424764cb046622b72364"
server_key_iv: "9c4f4019e4a76c21216605e78efdd434"
server_key_version: "encryptionkey@0"
I20260806 20:31:17.338361 15779 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 20:31:17.342061 15803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:17.343454 15779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:31:17.343590 15779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "3d26132ae3cb4120ab42dc05268cb9f5"
format_stamp: "Formatted at 2026-08-06 20:31:17 on dist-test-slave-2kcd"
server_key: "9ddb19dbca38424764cb046622b72364"
server_key_iv: "9c4f4019e4a76c21216605e78efdd434"
server_key_version: "encryptionkey@0"
I20260806 20:31:17.343765 15779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:17.368322 15779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:17.373057 15779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:17.373323 15779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:17.376206 15779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:17.376327 15779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:17.376461 15779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:17.376536 15779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:31:17 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048277, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:17.403839 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.376913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:55675 (local address 127.13.149.126:41817)
0806 20:31:17.379510 (+ 2597us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:17.379524 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:17.379552 (+ 28us) server_negotiation.cc:407] Connection header received
0806 20:31:17.381377 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:17.381395 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:17.381541 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:17.381701 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:17.384825 (+ 3124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.385802 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.388961 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.389531 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.389705 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.395484 (+ 5779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:17.395489 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:17.395493 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:17.395552 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:17.399632 (+ 4080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.400941 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.400949 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.400955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.401134 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.401856 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.401861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.401863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.402145 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:17.402263 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:17.403392 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0806 20:31:17.403577 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2440,"thread_start_us":2322,"threads_started":1}
I20260806 20:31:17.406186 15820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.377630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41817 (local address 127.13.149.65:55675)
0806 20:31:17.378780 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:17.378860 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:17.381094 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:17.382200 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:17.382219 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:17.383201 (+ 982us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:17.384503 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.384539 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.385966 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.385975 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.388750 (+ 2775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.388772 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.390093 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.390102 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.390394 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.391304 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:17.391347 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:17.395208 (+ 3861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:17.399841 (+ 4633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.399851 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.399873 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.400742 (+ 869us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.401281 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.401289 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.401298 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.401687 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.402291 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:17.402304 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:17.402908 (+ 604us) client_negotiation.cc:769] Sending connection context
0806 20:31:17.403298 (+ 390us) client_negotiation.cc:240] Negotiation successful
0806 20:31:17.404122 (+ 824us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":480,"threads_started":1}
I20260806 20:31:17.428025 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.412924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:35251 (local address 127.13.149.126:41817)
0806 20:31:17.413136 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:17.413143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:17.413976 (+ 833us) server_negotiation.cc:407] Connection header received
0806 20:31:17.414177 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:17.414182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:17.414254 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:17.414370 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:17.415326 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.416044 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.418025 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.418651 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.418785 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.421362 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:17.421368 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:17.421379 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:17.421447 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:17.424360 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.425484 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.425492 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.425497 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.425677 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.426143 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.426148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.426152 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.426624 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:17.426823 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:17.427382 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 20:31:17.427622 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 20:31:17.428113 15932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.413003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41817 (local address 127.13.149.65:35251)
0806 20:31:17.413856 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:17.413876 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:17.414050 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:17.414398 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:17.414402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:17.414891 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:17.415179 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.415189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.416205 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.416213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.417761 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.417782 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.418871 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.418877 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.419065 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.419873 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:17.419890 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:17.421154 (+ 1264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:17.424519 (+ 3365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.424524 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.424528 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.425316 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.425788 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.425793 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.425797 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.425971 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.426789 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:17.426794 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:17.427092 (+ 298us) client_negotiation.cc:769] Sending connection context
0806 20:31:17.427269 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 20:31:17.427630 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":501,"threads_started":1}
I20260806 20:31:17.433867 15779 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:44065
I20260806 20:31:17.433898 16002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:44065 every 8 connection(s)
I20260806 20:31:17.435062 15779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:17.437101 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15779
I20260806 20:31:17.437146 16003 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41817
I20260806 20:31:17.437345 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:17.437404 16003 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:17.438058 13909 external_mini_cluster.cc:1428] Setting key b7f133f1e012686d4ee12e4c089d094e
I20260806 20:31:17.438184 16003 heartbeater.cc:511] Master 127.13.149.126:41817 requested a full tablet report, sending...
I20260806 20:31:17.440671 15656 ts_manager.cc:194] Registered new tserver with Master: 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65:44065)
I20260806 20:31:17.443020 15656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:55675
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:17.483570 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41817
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:17.824126 16008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:17.824469 16008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:17.824671 16008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:17.832067 16008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:17.832238 16008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:17.832415 16008 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:31:17.832576 16008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:17.843796 16008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:41817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:17.845304 16008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:17.846764 16008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:17.860602 16015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:17.860621 16016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:17.860960 16020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:17.862219 16008 server_base.cc:1034] running on GCE node
I20260806 20:31:17.862895 16008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:17.863935 16008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:17.865239 16008 hybrid_clock.cc:648] HybridClock initialized: now 1786048277865165 us; error 48 us; skew 500 ppm
I20260806 20:31:17.865604 16008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:17 dist-test-slave-2kcd krb5kdc[15579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048277, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:17.869074 16008 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:17.870580 16008 webserver.cc:460] Webserver started at http://127.13.149.66:46415/ using document root <none> and password file <none>
I20260806 20:31:17.871318 16008 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:17.871464 16008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:17.871877 16008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:17.875105 16008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "dd60fef562624217ba34314b3609e769"
format_stamp: "Formatted at 2026-08-06 20:31:17 on dist-test-slave-2kcd"
server_key: "66e84366ad34657039549b2298173f63"
server_key_iv: "eae492a4ac07967c529ecb4df18c064b"
server_key_version: "encryptionkey@0"
I20260806 20:31:17.875950 16008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "dd60fef562624217ba34314b3609e769"
format_stamp: "Formatted at 2026-08-06 20:31:17 on dist-test-slave-2kcd"
server_key: "66e84366ad34657039549b2298173f63"
server_key_iv: "eae492a4ac07967c529ecb4df18c064b"
server_key_version: "encryptionkey@0"
I20260806 20:31:17.881249 16008 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 20:31:17.885042 16033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:17.886402 16008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:31:17.886612 16008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "dd60fef562624217ba34314b3609e769"
format_stamp: "Formatted at 2026-08-06 20:31:17 on dist-test-slave-2kcd"
server_key: "66e84366ad34657039549b2298173f63"
server_key_iv: "eae492a4ac07967c529ecb4df18c064b"
server_key_version: "encryptionkey@0"
I20260806 20:31:17.886866 16008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:17.901293 16008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:17.906240 16008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:17.906585 16008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:17.910048 16008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:17.910205 16008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:17.910579 16008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:17.910681 16008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:31:17 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048277, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:17.936167 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.910249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:39881 (local address 127.13.149.126:41817)
0806 20:31:17.910460 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:17.910465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:17.911947 (+ 1482us) server_negotiation.cc:407] Connection header received
0806 20:31:17.915152 (+ 3205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:17.915160 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:17.915268 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:17.915391 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:17.918108 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.919041 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.922528 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.923165 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.923310 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.929227 (+ 5917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:17.929233 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:17.929238 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:17.929288 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:17.933128 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.933849 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.933855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.933863 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.933985 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.934460 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.934464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.934466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.934726 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:17.934894 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:17.935573 (+ 679us) server_negotiation.cc:299] Negotiation successful
0806 20:31:17.935791 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:31:17.937448 16050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.910739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41817 (local address 127.13.149.66:39881)
0806 20:31:17.911743 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:17.911811 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:17.914795 (+ 2984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:17.915697 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:17.915710 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:17.916682 (+ 972us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:17.917862 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.917903 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.919293 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.919303 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.922281 (+ 2978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.922303 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.923438 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.923446 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.923726 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.924663 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:17.924703 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:17.928934 (+ 4231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:17.933276 (+ 4342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.933290 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.933304 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.933712 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.934116 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.934122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.934125 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.934332 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.934864 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:17.934872 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:17.935213 (+ 341us) client_negotiation.cc:769] Sending connection context
0806 20:31:17.935464 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 20:31:17.935966 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":458,"threads_started":1}
I20260806 20:31:17.961117 16153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.944886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41817 (local address 127.13.149.66:50169)
0806 20:31:17.945720 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:17.945740 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:17.945913 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:17.946370 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:17.946377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:17.946873 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:17.947181 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.947190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.949102 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.949113 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.950644 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:17.950659 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.951639 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.951646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:17.951802 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.952583 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:17.952599 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:17.953739 (+ 1140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:17.958408 (+ 4669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.958412 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.958414 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.958790 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.959295 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:17.959298 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:17.959300 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:17.959414 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:17.960280 (+ 866us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:17.960283 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:17.960424 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 20:31:17.960533 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 20:31:17.960749 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":466,"threads_started":1}
I20260806 20:31:17.961612 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:17.944869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:50169 (local address 127.13.149.126:41817)
0806 20:31:17.945078 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:17.945086 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:17.945831 (+ 745us) server_negotiation.cc:407] Connection header received
0806 20:31:17.946078 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:17.946086 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:17.946184 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:17.946334 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:17.947350 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.948931 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.950802 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:17.951431 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:17.951564 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:17.953982 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:17.953992 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:17.953999 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:17.954040 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:17.958222 (+ 4182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.958915 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.958924 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.958931 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.959167 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:17.959527 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:17.959535 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:17.959541 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:17.960142 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:17.960362 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:17.960699 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 20:31:17.961044 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:31:17.967527 16008 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:37409
I20260806 20:31:17.967623 16215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:37409 every 8 connection(s)
I20260806 20:31:17.968931 16008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:17.970888 16219 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41817
I20260806 20:31:17.971115 16219 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:17.971725 16219 heartbeater.cc:511] Master 127.13.149.126:41817 requested a full tablet report, sending...
I20260806 20:31:17.973093 15656 ts_manager.cc:194] Registered new tserver with Master: dd60fef562624217ba34314b3609e769 (127.13.149.66:37409)
I20260806 20:31:17.973809 15656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:39881
I20260806 20:31:17.974566 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16008
I20260806 20:31:17.974782 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:17.975235 13909 external_mini_cluster.cc:1428] Setting key 4cc2694c871e4f5a137eb108b23d1549
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:18.019280 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41817
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:18.348968 16223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:18.349220 16223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:18.349385 16223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:18.356480 16223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:18.356595 16223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:18.356758 16223 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:31:18.356892 16223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:18.366550 16223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:41817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:18.367794 16223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:18.369179 16223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:18.382639 16232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:18.382592 16236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:18.382679 16238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:18.383780 16223 server_base.cc:1034] running on GCE node
I20260806 20:31:18.384425 16223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:18.385396 16223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:18.386608 16223 hybrid_clock.cc:648] HybridClock initialized: now 1786048278386526 us; error 53 us; skew 500 ppm
I20260806 20:31:18.386912 16223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:18 dist-test-slave-2kcd krb5kdc[15579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048278, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:18.394845 16223 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:18.396423 16223 webserver.cc:460] Webserver started at http://127.13.149.67:37711/ using document root <none> and password file <none>
I20260806 20:31:18.397214 16223 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:18.397358 16223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:18.397701 16223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:18.400619 16223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "b81af8dff4cc40b4b416417ec5a0d2ba"
format_stamp: "Formatted at 2026-08-06 20:31:18 on dist-test-slave-2kcd"
server_key: "55105ee0edc0b306ed581e631cfd664d"
server_key_iv: "e234bc61ef87d6be78beacce57104876"
server_key_version: "encryptionkey@0"
I20260806 20:31:18.401484 16223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "b81af8dff4cc40b4b416417ec5a0d2ba"
format_stamp: "Formatted at 2026-08-06 20:31:18 on dist-test-slave-2kcd"
server_key: "55105ee0edc0b306ed581e631cfd664d"
server_key_iv: "e234bc61ef87d6be78beacce57104876"
server_key_version: "encryptionkey@0"
I20260806 20:31:18.406459 16223 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 20:31:18.409991 16248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:18.411238 16223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:31:18.411424 16223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "b81af8dff4cc40b4b416417ec5a0d2ba"
format_stamp: "Formatted at 2026-08-06 20:31:18 on dist-test-slave-2kcd"
server_key: "55105ee0edc0b306ed581e631cfd664d"
server_key_iv: "e234bc61ef87d6be78beacce57104876"
server_key_version: "encryptionkey@0"
I20260806 20:31:18.411644 16223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:18.440003 16223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:18.444211 16223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:18.444535 16223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:18.445969 16003 heartbeater.cc:503] Master 127.13.149.126:41817 was elected leader, sending a full tablet report...
I20260806 20:31:18.447718 16223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:18.447866 16223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:18.448052 16223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:18.448407 16223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:31:18 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048278, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:18.473201 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.448290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:42077 (local address 127.13.149.126:41817)
0806 20:31:18.448476 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.448483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.450017 (+ 1534us) server_negotiation.cc:407] Connection header received
0806 20:31:18.452048 (+ 2031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.452053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.452143 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.452254 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:18.454335 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.455677 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.458657 (+ 2980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.459035 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.459169 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.464034 (+ 4865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:18.464039 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:18.464042 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:18.464075 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:18.467998 (+ 3923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.469261 (+ 1263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.469266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.469271 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.469454 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.470189 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.470194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.470197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.470685 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:18.470853 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.472569 (+ 1716us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.472836 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:31:18.473934 16260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.448948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41817 (local address 127.13.149.67:42077)
0806 20:31:18.449854 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.449899 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.451771 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.452498 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.452506 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.453285 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:18.454115 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.454137 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.455913 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.455922 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.458402 (+ 2480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.458475 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.459276 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.459284 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.459627 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.460498 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:18.460537 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:18.463809 (+ 3272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:18.468224 (+ 4415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:18.468237 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:18.468259 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:18.469072 (+ 813us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:18.469637 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:18.469646 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:18.469650 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:18.470010 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:18.470989 (+ 979us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:18.471004 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:18.471618 (+ 614us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.472028 (+ 410us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.472658 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":390,"threads_started":1}
I20260806 20:31:18.496346 16223 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:38067
I20260806 20:31:18.496366 16432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:38067 every 8 connection(s)
I20260806 20:31:18.497932 16223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:18.500300 16433 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41817
I20260806 20:31:18.500584 16433 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:18.501322 16433 heartbeater.cc:511] Master 127.13.149.126:41817 requested a full tablet report, sending...
I20260806 20:31:18.502717 15656 ts_manager.cc:194] Registered new tserver with Master: b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067)
I20260806 20:31:18.502908 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.488288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:43913 (local address 127.13.149.126:41817)
0806 20:31:18.488528 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.488537 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.489146 (+ 609us) server_negotiation.cc:407] Connection header received
0806 20:31:18.489426 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.489431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.489516 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.489623 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:18.490562 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.491571 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.493859 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.494269 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.494423 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.496426 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:18.496432 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:18.496436 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:18.496475 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:18.499818 (+ 3343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.500751 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.500757 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.500761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.500930 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.501316 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.501323 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.501326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.501670 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:18.501831 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.502254 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.502483 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 20:31:18.502955 16408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.488293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41817 (local address 127.13.149.67:43913)
0806 20:31:18.489017 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.489042 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.489215 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.489662 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.489667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.490141 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:18.490417 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.490426 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.491704 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.491709 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.493674 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.493699 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.494468 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.494474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.494659 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.495372 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:18.495403 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:18.496223 (+ 820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:18.500005 (+ 3782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:18.500009 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:18.500012 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:18.500618 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:18.501051 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:18.501055 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:18.501059 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:18.501199 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:18.501790 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:18.501794 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:18.501982 (+ 188us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.502155 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.502453 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":374,"threads_started":1}
I20260806 20:31:18.503772 15656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:42077
I20260806 20:31:18.507894 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16223
I20260806 20:31:18.508106 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:18.508612 13909 external_mini_cluster.cc:1428] Setting key 7f3a74cac7ea992cc772344936d74c67
I20260806 20:31:18.511551 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 20:31:18 dist-test-slave-2kcd krb5kdc[15579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048278, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 20:31:18 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048278, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:18.561769 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.547736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34206 (local address 127.13.149.126:41817)
0806 20:31:18.547913 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.547917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.548337 (+ 420us) server_negotiation.cc:407] Connection header received
0806 20:31:18.548503 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.548507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.548585 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.548676 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:18.550195 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.550928 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.552229 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.552615 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.552707 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.556583 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:18.556588 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:18.556591 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:18.556624 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:18.559300 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.559920 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.559924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.559926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.560061 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.560471 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.560474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.560476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.560746 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:18.561042 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.561304 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.561479 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 20:31:18.566015 15656 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:18.573063 15656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:18.612376 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.585321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41366 (local address 127.13.149.66:37409)
0806 20:31:18.599730 (+ 14409us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.599744 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.603738 (+ 3994us) server_negotiation.cc:407] Connection header received
0806 20:31:18.603873 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.603885 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.604241 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.604457 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:18.605624 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.606936 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.609731 (+ 2795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.611161 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.611318 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.611537 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.611861 (+ 324us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.612047 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14193,"thread_start_us":14063,"threads_started":1}
I20260806 20:31:18.612442 16463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.585185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:37409 (local address 127.0.0.1:41366)
0806 20:31:18.603228 (+ 18043us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.603280 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.603500 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.604828 (+ 1328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.604835 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.604863 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:18.605393 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.605407 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.607062 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.607069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.609535 (+ 2466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.609550 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.611384 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.611390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.611580 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.611632 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.611773 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.611981 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17647,"mutex_wait_us":1,"thread_start_us":19890,"threads_started":1}
I20260806 20:31:18.613251 16468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.585272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44065 (local address 127.0.0.1:51220)
0806 20:31:18.604489 (+ 19217us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.604511 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.604637 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.605579 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.605583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.605613 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:18.606005 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.606020 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.608074 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.608079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.610379 (+ 2300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.610397 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.612292 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.612298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.612513 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.612555 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.612657 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.612827 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19092,"mutex_wait_us":72,"thread_start_us":17398,"threads_started":1}
I20260806 20:31:18.613481 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.585918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:38067 (local address 127.0.0.1:49360)
0806 20:31:18.605365 (+ 19447us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.605379 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.605537 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.606194 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.606199 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.606225 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:18.606575 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.606587 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.608647 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.608653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.610592 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.610607 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.612642 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.612647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.612841 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.612876 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.612977 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.613102 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19316,"mutex_wait_us":45,"thread_start_us":18294,"threads_started":1}
I20260806 20:31:18.613945 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.585841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.13.149.65:44065)
0806 20:31:18.604973 (+ 19132us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.604984 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.605013 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:31:18.605107 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.605116 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.605341 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.606197 (+ 856us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:18.606410 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.607926 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.610573 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.611831 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.611958 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.612146 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.613487 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.613654 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18917,"thread_start_us":18750,"threads_started":1}
I20260806 20:31:18.614177 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.586760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49360 (local address 127.13.149.67:38067)
0806 20:31:18.604001 (+ 17241us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.604014 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.605504 (+ 1490us) server_negotiation.cc:407] Connection header received
0806 20:31:18.605734 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.605742 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.605991 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.606185 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:18.606792 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.608494 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.610762 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.612118 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.612242 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.612472 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.613671 (+ 1199us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.613846 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17006,"thread_start_us":16829,"threads_started":1}
I20260806 20:31:18.617002 16114 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae30b81ec9f4545b35163e84f706e2d (DEFAULT_TABLE table=test-table [id=d8d04c8c7a3a4619a1291211023ab241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:18.617390 15884 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae30b81ec9f4545b35163e84f706e2d (DEFAULT_TABLE table=test-table [id=d8d04c8c7a3a4619a1291211023ab241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:18.618589 16114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae30b81ec9f4545b35163e84f706e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.618763 15884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae30b81ec9f4545b35163e84f706e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.619387 16326 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae30b81ec9f4545b35163e84f706e2d (DEFAULT_TABLE table=test-table [id=d8d04c8c7a3a4619a1291211023ab241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:18.620446 16326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae30b81ec9f4545b35163e84f706e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.631664 16472 tablet_bootstrap.cc:492] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Bootstrap starting.
I20260806 20:31:18.633490 16474 tablet_bootstrap.cc:492] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Bootstrap starting.
I20260806 20:31:18.636889 16472 tablet_bootstrap.cc:654] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:18.636888 16474 tablet_bootstrap.cc:654] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:18.638285 16472 log.cc:824] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:18.638267 16474 log.cc:824] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:18.641018 16477 tablet_bootstrap.cc:492] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Bootstrap starting.
I20260806 20:31:18.642467 16474 tablet_bootstrap.cc:492] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: No bootstrap required, opened a new log
I20260806 20:31:18.642827 16474 ts_tablet_manager.cc:1397] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 20:31:18.644405 16477 tablet_bootstrap.cc:654] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:18.645840 16477 log.cc:824] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:18.647784 16472 tablet_bootstrap.cc:492] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: No bootstrap required, opened a new log
I20260806 20:31:18.648068 16472 ts_tablet_manager.cc:1397] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.010s
I20260806 20:31:18.649317 16477 tablet_bootstrap.cc:492] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: No bootstrap required, opened a new log
I20260806 20:31:18.649597 16477 ts_tablet_manager.cc:1397] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260806 20:31:18.653995 16474 raft_consensus.cc:348] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.654479 16474 raft_consensus.cc:374] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:18.654577 16474 raft_consensus.cc:729] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd60fef562624217ba34314b3609e769, State: Initialized, Role: FOLLOWER
I20260806 20:31:18.655230 16474 consensus_queue.cc:260] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.656418 16219 heartbeater.cc:503] Master 127.13.149.126:41817 was elected leader, sending a full tablet report...
I20260806 20:31:18.657121 16474 ts_tablet_manager.cc:1428] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
I20260806 20:31:18.658215 16477 raft_consensus.cc:348] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.658617 16477 raft_consensus.cc:374] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:18.658743 16477 raft_consensus.cc:729] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d26132ae3cb4120ab42dc05268cb9f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:18.658985 16472 raft_consensus.cc:348] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.659405 16472 raft_consensus.cc:374] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:18.659510 16472 raft_consensus.cc:729] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81af8dff4cc40b4b416417ec5a0d2ba, State: Initialized, Role: FOLLOWER
I20260806 20:31:18.659350 16477 consensus_queue.cc:260] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.660081 16472 consensus_queue.cc:260] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.662031 16433 heartbeater.cc:503] Master 127.13.149.126:41817 was elected leader, sending a full tablet report...
I20260806 20:31:18.662237 16477 ts_tablet_manager.cc:1428] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s
I20260806 20:31:18.663671 16472 ts_tablet_manager.cc:1428] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
W20260806 20:31:18.687532 16004 tablet.cc:2369] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:31:18.688748 16482 raft_consensus.cc:482] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:18.689131 16482 raft_consensus.cc:504] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.691272 16482 leader_election.cc:288] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65:44065), b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067)
I20260806 20:31:18.698009 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.691363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:44167 (local address 127.13.149.65:44065)
0806 20:31:18.691623 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.691629 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.692544 (+ 915us) server_negotiation.cc:407] Connection header received
0806 20:31:18.692814 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.692819 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.692921 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.693031 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:18.693607 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.694348 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.696213 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.697060 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.697251 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.697331 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.697612 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.697753 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 20:31:18.698163 16486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.691652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44065 (local address 127.13.149.66:44167)
0806 20:31:18.692426 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.692442 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.692635 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.693056 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.693061 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.693125 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:18.693463 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.693472 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.694494 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.694499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.696054 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.696066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.697280 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.697286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.697445 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.697470 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.697586 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.697727 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"mutex_wait_us":1,"spinlock_wait_cycles":51456,"thread_start_us":768,"threads_started":1}
I20260806 20:31:18.698320 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.691713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:41921 (local address 127.13.149.67:38067)
0806 20:31:18.691982 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.691991 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.693053 (+ 1062us) server_negotiation.cc:407] Connection header received
0806 20:31:18.693288 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.693297 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.693359 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.693460 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:18.694083 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.694779 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.696517 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.697386 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.697577 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.697652 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.697953 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.698082 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 20:31:18.698990 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.692208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:38067 (local address 127.13.149.66:41921)
0806 20:31:18.692943 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.692958 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.693141 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.693484 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.693488 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.693513 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:18.693927 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.693938 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.694937 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.694942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.696331 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.696344 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.697611 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.697618 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.697785 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.697808 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.697925 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.698053 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"spinlock_wait_cycles":1792,"thread_start_us":470,"threads_started":1}
I20260806 20:31:18.699287 15928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae30b81ec9f4545b35163e84f706e2d" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" is_pre_election: true
I20260806 20:31:18.699837 15928 raft_consensus.cc:2454] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 0.
I20260806 20:31:18.700088 16362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae30b81ec9f4545b35163e84f706e2d" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" is_pre_election: true
I20260806 20:31:18.700585 16035 leader_election.cc:302] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d26132ae3cb4120ab42dc05268cb9f5, dd60fef562624217ba34314b3609e769; no voters:
I20260806 20:31:18.700630 16362 raft_consensus.cc:2454] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 0.
I20260806 20:31:18.701093 16482 raft_consensus.cc:2781] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:18.701260 16482 raft_consensus.cc:482] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:18.701428 16482 raft_consensus.cc:3037] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:18.703709 16482 raft_consensus.cc:504] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.704341 16482 leader_election.cc:288] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 election: Requested vote from peers 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65:44065), b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067)
I20260806 20:31:18.704878 16362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae30b81ec9f4545b35163e84f706e2d" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba"
I20260806 20:31:18.704913 15928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae30b81ec9f4545b35163e84f706e2d" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d26132ae3cb4120ab42dc05268cb9f5"
I20260806 20:31:18.705125 15928 raft_consensus.cc:3037] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:18.705121 16362 raft_consensus.cc:3037] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:18.708470 16362 raft_consensus.cc:2454] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 1.
I20260806 20:31:18.708505 15928 raft_consensus.cc:2454] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 1.
I20260806 20:31:18.708940 16034 leader_election.cc:302] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3d26132ae3cb4120ab42dc05268cb9f5, b81af8dff4cc40b4b416417ec5a0d2ba, dd60fef562624217ba34314b3609e769; no voters:
I20260806 20:31:18.709286 16482 raft_consensus.cc:2781] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:18.709780 16482 raft_consensus.cc:686] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 1 LEADER]: Becoming Leader. State: Replica: dd60fef562624217ba34314b3609e769, State: Running, Role: LEADER
I20260806 20:31:18.710359 16482 consensus_queue.cc:237] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.715555 15657 catalog_manager.cc:5495] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd60fef562624217ba34314b3609e769 (127.13.149.66). New cstate: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } health_report { overall_health: UNKNOWN } } }
W20260806 20:31:18.721035 16220 tablet.cc:2369] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:31:18.750226 16436 tablet.cc:2369] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:31:18.756569 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.751014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41374 (local address 127.13.149.66:37409)
0806 20:31:18.751188 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.751193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.751286 (+ 93us) server_negotiation.cc:407] Connection header received
0806 20:31:18.751624 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.751628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.751720 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.751866 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:18.752260 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.753056 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.754401 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.754830 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.754981 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.755467 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:18.755938 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:18.756120 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.756203 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.756283 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 20:31:18.764382 15928 raft_consensus.cc:1261] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Refusing update from remote peer dd60fef562624217ba34314b3609e769: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:18.764427 16362 raft_consensus.cc:1261] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Refusing update from remote peer dd60fef562624217ba34314b3609e769: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:18.765373 16490 consensus_queue.cc:1035] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:18.765719 16482 consensus_queue.cc:1035] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:18.778386 16498 mvcc.cc:205] Tried to move back new op lower bound from 7315653749809549312 to 7315653749602070528. Current Snapshot: MvccSnapshot[applied={T|T < 7315653749809549312}]
I20260806 20:31:18.785216 16496 mvcc.cc:205] Tried to move back new op lower bound from 7315653749809549312 to 7315653749602070528. Current Snapshot: MvccSnapshot[applied={T|T < 7315653749809549312}]
I20260806 20:31:18.794490 15657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:18.794777 15657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:18.799036 15657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1: Sending DeleteTablet for 3 replicas of tablet 3ae30b81ec9f4545b35163e84f706e2d
I20260806 20:31:18.800136 16114 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae30b81ec9f4545b35163e84f706e2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:18 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41366
I20260806 20:31:18.800614 15884 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae30b81ec9f4545b35163e84f706e2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:18 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:51220
I20260806 20:31:18.802884 16326 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae30b81ec9f4545b35163e84f706e2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:18 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:49360
I20260806 20:31:18.808349 16513 tablet_replica.cc:330] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: stopping tablet replica
I20260806 20:31:18.810065 15657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:18.810708 15657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:18.812870 16510 tablet_replica.cc:330] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: stopping tablet replica
I20260806 20:31:18.813478 16510 raft_consensus.cc:2229] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:31:18.814242 16510 raft_consensus.cc:2258] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:18.815639 16513 raft_consensus.cc:2229] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:18.816187 16513 raft_consensus.cc:2258] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:18.816860 16510 ts_tablet_manager.cc:1905] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:18.818292 16513 ts_tablet_manager.cc:1905] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:18.818699 15883 tablet_service.cc:1467] Processing CreateTablet for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 (DEFAULT_TABLE table=test-table [id=79a7c6d97bf0485094954fa20bbd63cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:18.819015 16114 tablet_service.cc:1467] Processing CreateTablet for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 (DEFAULT_TABLE table=test-table [id=79a7c6d97bf0485094954fa20bbd63cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:18.819304 15883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.819337 16114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.821419 16326 tablet_service.cc:1467] Processing CreateTablet for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 (DEFAULT_TABLE table=test-table [id=79a7c6d97bf0485094954fa20bbd63cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:18.821967 16326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.824962 16474 tablet_bootstrap.cc:492] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: Bootstrap starting.
I20260806 20:31:18.825523 16513 ts_tablet_manager.cc:1918] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:18.825706 16513 log.cc:1196] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/3ae30b81ec9f4545b35163e84f706e2d
I20260806 20:31:18.826258 16477 tablet_bootstrap.cc:492] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: Bootstrap starting.
I20260806 20:31:18.826329 16513 ts_tablet_manager.cc:1939] T 3ae30b81ec9f4545b35163e84f706e2d P b81af8dff4cc40b4b416417ec5a0d2ba: Deleting consensus metadata
I20260806 20:31:18.826673 16474 tablet_bootstrap.cc:654] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:18.827899 16477 tablet_bootstrap.cc:654] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:18.828307 15633 catalog_manager.cc:4841] TS b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067): tablet 3ae30b81ec9f4545b35163e84f706e2d (table test-table [id=d8d04c8c7a3a4619a1291211023ab241]) successfully deleted
I20260806 20:31:18.832695 16472 tablet_bootstrap.cc:492] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: Bootstrap starting.
I20260806 20:31:18.834945 16472 tablet_bootstrap.cc:654] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:18.837618 16511 tablet_replica.cc:330] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: stopping tablet replica
I20260806 20:31:18.838136 16511 raft_consensus.cc:2229] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:18.838742 16511 raft_consensus.cc:2258] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:18.841418 16474 tablet_bootstrap.cc:492] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: No bootstrap required, opened a new log
I20260806 20:31:18.841607 16474 ts_tablet_manager.cc:1397] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.007s
I20260806 20:31:18.842329 16477 tablet_bootstrap.cc:492] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: No bootstrap required, opened a new log
I20260806 20:31:18.842657 16477 ts_tablet_manager.cc:1397] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.009s
I20260806 20:31:18.842542 16474 raft_consensus.cc:348] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.842778 16474 raft_consensus.cc:374] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:18.842908 16474 raft_consensus.cc:729] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd60fef562624217ba34314b3609e769, State: Initialized, Role: FOLLOWER
I20260806 20:31:18.842971 16511 ts_tablet_manager.cc:1905] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:18.843798 16472 tablet_bootstrap.cc:492] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: No bootstrap required, opened a new log
I20260806 20:31:18.843986 16472 ts_tablet_manager.cc:1397] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.003s
I20260806 20:31:18.843789 16477 raft_consensus.cc:348] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.844237 16477 raft_consensus.cc:374] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:18.844409 16477 raft_consensus.cc:729] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d26132ae3cb4120ab42dc05268cb9f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:18.844821 16472 raft_consensus.cc:348] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.845070 16472 raft_consensus.cc:374] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:18.845165 16472 raft_consensus.cc:729] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81af8dff4cc40b4b416417ec5a0d2ba, State: Initialized, Role: FOLLOWER
I20260806 20:31:18.844944 16477 consensus_queue.cc:260] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.846082 16472 consensus_queue.cc:260] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.846812 16472 ts_tablet_manager.cc:1428] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 20:31:18.848773 16477 ts_tablet_manager.cc:1428] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260806 20:31:18.850253 16511 ts_tablet_manager.cc:1918] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:18.850436 16511 log.cc:1196] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/3ae30b81ec9f4545b35163e84f706e2d
I20260806 20:31:18.851039 16511 ts_tablet_manager.cc:1939] T 3ae30b81ec9f4545b35163e84f706e2d P 3d26132ae3cb4120ab42dc05268cb9f5: Deleting consensus metadata
I20260806 20:31:18.848064 16474 consensus_queue.cc:260] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.852907 15638 catalog_manager.cc:4841] TS 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65:44065): tablet 3ae30b81ec9f4545b35163e84f706e2d (table test-table [id=d8d04c8c7a3a4619a1291211023ab241]) successfully deleted
I20260806 20:31:18.853394 16510 ts_tablet_manager.cc:1918] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:18.853606 16510 log.cc:1196] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/3ae30b81ec9f4545b35163e84f706e2d
I20260806 20:31:18.854215 16510 ts_tablet_manager.cc:1939] T 3ae30b81ec9f4545b35163e84f706e2d P dd60fef562624217ba34314b3609e769: Deleting consensus metadata
I20260806 20:31:18.854750 16474 ts_tablet_manager.cc:1428] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260806 20:31:18.856097 15640 catalog_manager.cc:4841] TS dd60fef562624217ba34314b3609e769 (127.13.149.66:37409): tablet 3ae30b81ec9f4545b35163e84f706e2d (table test-table [id=d8d04c8c7a3a4619a1291211023ab241]) successfully deleted
I20260806 20:31:18.884992 16484 raft_consensus.cc:482] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:18.885262 16484 raft_consensus.cc:504] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.887280 16484 leader_election.cc:288] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd60fef562624217ba34314b3609e769 (127.13.149.66:37409), b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067)
I20260806 20:31:18.896523 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.887998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:53119 (local address 127.13.149.66:37409)
0806 20:31:18.888257 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.888266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.888488 (+ 222us) server_negotiation.cc:407] Connection header received
0806 20:31:18.888841 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.888847 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.888934 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.888998 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:18.889855 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.891255 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.894070 (+ 2815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.895389 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.895571 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.895653 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.896010 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.896155 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 20:31:18.896677 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.887762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:59099 (local address 127.13.149.67:38067)
0806 20:31:18.887951 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.887957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.889299 (+ 1342us) server_negotiation.cc:407] Connection header received
0806 20:31:18.889686 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.889695 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.889810 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.889887 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:18.890863 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.892082 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.894554 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.895405 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.895606 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.895687 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.896239 (+ 552us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.896384 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 20:31:18.896929 16519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.887553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:37409 (local address 127.13.149.65:53119)
0806 20:31:18.888380 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.888400 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.888634 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.889223 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.889228 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.889256 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:18.889683 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.889695 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.891485 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.891489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.893864 (+ 2375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.893891 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.895636 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.895643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.895829 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.895856 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.895983 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.896132 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"spinlock_wait_cycles":24064,"thread_start_us":1647,"threads_started":1}
I20260806 20:31:18.897529 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.887649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:38067 (local address 127.13.149.65:59099)
0806 20:31:18.889192 (+ 1543us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.889213 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.889456 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.890140 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.890145 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.890206 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:18.890663 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.890676 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.892236 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.892242 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.894391 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.894402 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.895845 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.895851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.896045 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.896078 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.896968 (+ 890us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.897111 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1368,"spinlock_wait_cycles":896,"thread_start_us":674,"threads_started":1}
I20260806 20:31:18.898334 16362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f01787f14b4e4ea36b09e6dfa5c6c2" candidate_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" is_pre_election: true
I20260806 20:31:18.898620 16362 raft_consensus.cc:2454] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d26132ae3cb4120ab42dc05268cb9f5 in term 0.
I20260806 20:31:18.898465 16146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f01787f14b4e4ea36b09e6dfa5c6c2" candidate_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd60fef562624217ba34314b3609e769" is_pre_election: true
I20260806 20:31:18.899034 16146 raft_consensus.cc:2454] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d26132ae3cb4120ab42dc05268cb9f5 in term 0.
I20260806 20:31:18.899158 15805 leader_election.cc:302] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d26132ae3cb4120ab42dc05268cb9f5, b81af8dff4cc40b4b416417ec5a0d2ba; no voters:
I20260806 20:31:18.899602 16484 raft_consensus.cc:2781] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:18.899746 16484 raft_consensus.cc:482] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:18.899854 16484 raft_consensus.cc:3037] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:18.903195 16484 raft_consensus.cc:504] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.903970 16484 leader_election.cc:288] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [CANDIDATE]: Term 1 election: Requested vote from peers dd60fef562624217ba34314b3609e769 (127.13.149.66:37409), b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067)
I20260806 20:31:18.904518 16362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f01787f14b4e4ea36b09e6dfa5c6c2" candidate_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba"
I20260806 20:31:18.904495 16146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f01787f14b4e4ea36b09e6dfa5c6c2" candidate_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd60fef562624217ba34314b3609e769"
I20260806 20:31:18.904750 16146 raft_consensus.cc:3037] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:18.904752 16362 raft_consensus.cc:3037] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:18.907135 16362 raft_consensus.cc:2454] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d26132ae3cb4120ab42dc05268cb9f5 in term 1.
I20260806 20:31:18.907614 15805 leader_election.cc:302] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d26132ae3cb4120ab42dc05268cb9f5, b81af8dff4cc40b4b416417ec5a0d2ba; no voters:
I20260806 20:31:18.907918 16484 raft_consensus.cc:2781] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:18.908313 16146 raft_consensus.cc:2454] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d26132ae3cb4120ab42dc05268cb9f5 in term 1.
I20260806 20:31:18.908650 16484 raft_consensus.cc:686] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d26132ae3cb4120ab42dc05268cb9f5, State: Running, Role: LEADER
I20260806 20:31:18.909173 16484 consensus_queue.cc:237] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:18.913196 15656 catalog_manager.cc:5495] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } health_report { overall_health: UNKNOWN } } }
Aug 06 20:31:18 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048276, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:18.972051 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.955329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34214 (local address 127.13.149.126:41817)
0806 20:31:18.955543 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:18.955551 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:18.956118 (+ 567us) server_negotiation.cc:407] Connection header received
0806 20:31:18.956324 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:18.956328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:18.956407 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:18.956517 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:18.958182 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.958936 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.960884 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.961324 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.961421 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.965277 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:18.965284 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:18.965289 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:18.965326 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:18.968747 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.969647 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.969663 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.969668 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.969830 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:18.970250 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:18.970255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:18.970258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:18.970613 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:18.970755 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:18.971361 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 20:31:18.971694 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":80,"server-negotiator.queue_time_us":69}
I20260806 20:31:18.972062 16535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:18.955325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41817 (local address 127.0.0.1:34214)
0806 20:31:18.955999 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:18.956020 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:18.956203 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:18.956606 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:18.956611 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:18.957639 (+ 1028us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:18.958017 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.958030 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.959072 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.959078 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.960693 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:18.960708 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:18.961505 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:18.961512 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:18.961690 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:18.962401 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:18.962426 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:18.965094 (+ 2668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:18.968904 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:18.968916 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:18.968923 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:18.969498 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:18.969959 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:18.969963 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:18.969967 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:18.970122 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:18.970839 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:18.970848 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:18.971038 (+ 190us) client_negotiation.cc:769] Sending connection context
0806 20:31:18.971217 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 20:31:18.971514 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":376,"threads_started":1}
I20260806 20:31:18.979455 15656 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:34214:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 20:31:18.980724 15656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:18.988456 15884 tablet_service.cc:1467] Processing CreateTablet for tablet c9efe26937f646be87ccd63a4289ccb2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4fd7518be7674ed1b9f6dad255adf6a4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:31:18.989131 15884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9efe26937f646be87ccd63a4289ccb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.989197 16114 tablet_service.cc:1467] Processing CreateTablet for tablet c9efe26937f646be87ccd63a4289ccb2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4fd7518be7674ed1b9f6dad255adf6a4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:31:18.989789 16114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9efe26937f646be87ccd63a4289ccb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.993292 16326 tablet_service.cc:1467] Processing CreateTablet for tablet c9efe26937f646be87ccd63a4289ccb2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4fd7518be7674ed1b9f6dad255adf6a4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:31:18.993862 16326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9efe26937f646be87ccd63a4289ccb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:18.995610 16477 tablet_bootstrap.cc:492] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: Bootstrap starting.
I20260806 20:31:18.997285 16477 tablet_bootstrap.cc:654] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:19.005501 16472 tablet_bootstrap.cc:492] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: Bootstrap starting.
I20260806 20:31:19.007275 16472 tablet_bootstrap.cc:654] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:19.007385 16474 tablet_bootstrap.cc:492] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: Bootstrap starting.
I20260806 20:31:19.008397 16477 tablet_bootstrap.cc:492] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: No bootstrap required, opened a new log
I20260806 20:31:19.008579 16477 ts_tablet_manager.cc:1397] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260806 20:31:19.009223 16474 tablet_bootstrap.cc:654] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:19.009436 16477 raft_consensus.cc:348] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.009713 16477 raft_consensus.cc:374] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:19.009801 16477 raft_consensus.cc:729] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d26132ae3cb4120ab42dc05268cb9f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:19.010088 16477 consensus_queue.cc:260] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.010608 16484 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.010924 16484 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:19.015368 16477 ts_tablet_manager.cc:1428] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260806 20:31:19.016327 16474 tablet_bootstrap.cc:492] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: No bootstrap required, opened a new log
I20260806 20:31:19.016496 16474 ts_tablet_manager.cc:1397] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260806 20:31:19.016901 16472 tablet_bootstrap.cc:492] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: No bootstrap required, opened a new log
I20260806 20:31:19.017076 16472 ts_tablet_manager.cc:1397] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.009s
I20260806 20:31:19.017297 16474 raft_consensus.cc:348] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.017534 16474 raft_consensus.cc:374] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:19.017637 16474 raft_consensus.cc:729] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd60fef562624217ba34314b3609e769, State: Initialized, Role: FOLLOWER
I20260806 20:31:19.017879 16472 raft_consensus.cc:348] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.017902 16474 consensus_queue.cc:260] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.018144 16472 raft_consensus.cc:374] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:19.018253 16472 raft_consensus.cc:729] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81af8dff4cc40b4b416417ec5a0d2ba, State: Initialized, Role: FOLLOWER
I20260806 20:31:19.018533 16472 consensus_queue.cc:260] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.018399 16507 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.018807 16507 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:19.019078 16472 ts_tablet_manager.cc:1428] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 20:31:19.019021 16485 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.019266 16474 ts_tablet_manager.cc:1428] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:19.019330 16485 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:19.034611 16507 raft_consensus.cc:482] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:19.034900 16507 raft_consensus.cc:504] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.035671 16507 leader_election.cc:288] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65:44065), b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067)
I20260806 20:31:19.036193 15928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9efe26937f646be87ccd63a4289ccb2" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" is_pre_election: true
I20260806 20:31:19.036206 16362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9efe26937f646be87ccd63a4289ccb2" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" is_pre_election: true
I20260806 20:31:19.036448 15928 raft_consensus.cc:2454] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 0.
I20260806 20:31:19.036468 16362 raft_consensus.cc:2454] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 0.
I20260806 20:31:19.036909 16034 leader_election.cc:302] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b81af8dff4cc40b4b416417ec5a0d2ba, dd60fef562624217ba34314b3609e769; no voters:
I20260806 20:31:19.037178 16507 raft_consensus.cc:2781] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:19.037314 16507 raft_consensus.cc:482] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:19.037452 16507 raft_consensus.cc:3037] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:19.040333 16507 raft_consensus.cc:504] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.041350 16507 leader_election.cc:288] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 election: Requested vote from peers 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65:44065), b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067)
I20260806 20:31:19.041486 15928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9efe26937f646be87ccd63a4289ccb2" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d26132ae3cb4120ab42dc05268cb9f5"
I20260806 20:31:19.041467 16362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9efe26937f646be87ccd63a4289ccb2" candidate_uuid: "dd60fef562624217ba34314b3609e769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba"
I20260806 20:31:19.041656 15928 raft_consensus.cc:3037] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:19.041704 16362 raft_consensus.cc:3037] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:19.043916 15928 raft_consensus.cc:2454] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 1.
I20260806 20:31:19.044677 16362 raft_consensus.cc:2454] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd60fef562624217ba34314b3609e769 in term 1.
I20260806 20:31:19.045055 16035 leader_election.cc:302] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d26132ae3cb4120ab42dc05268cb9f5, dd60fef562624217ba34314b3609e769; no voters:
I20260806 20:31:19.045399 16507 raft_consensus.cc:2781] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:19.045575 16507 raft_consensus.cc:686] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [term 1 LEADER]: Becoming Leader. State: Replica: dd60fef562624217ba34314b3609e769, State: Running, Role: LEADER
I20260806 20:31:19.046108 16507 consensus_queue.cc:237] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } }
I20260806 20:31:19.047874 16490 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: TxnStatusTablet state changed. Reason: New leader dd60fef562624217ba34314b3609e769. Latest consensus state: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.048292 16490 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:31:19.049398 16543 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 20:31:19.049727 16543 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 20:31:19.049618 15655 catalog_manager.cc:5495] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd60fef562624217ba34314b3609e769 (127.13.149.66). New cstate: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260806 20:31:19.068228 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.062580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41380 (local address 127.13.149.66:37409)
0806 20:31:19.063092 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.063097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.063110 (+ 13us) server_negotiation.cc:407] Connection header received
0806 20:31:19.063157 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.063160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.063220 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.063287 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:19.063761 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.064584 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.066382 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.066828 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.066955 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.067537 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:19.067643 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:19.067738 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.067935 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.068000 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396}
I20260806 20:31:19.068397 16535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.062490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:37409 (local address 127.0.0.1:41380)
0806 20:31:19.062722 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:19.062740 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:19.062842 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:19.063363 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:19.063368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:19.063382 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:19.063592 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:19.063602 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.064719 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.064726 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:19.066218 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:19.066235 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.067019 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.067025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:19.067239 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.067309 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:19.067774 (+ 465us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:19.067801 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 20:31:19.067896 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 20:31:19.068053 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 20:31:19.072364 15928 raft_consensus.cc:1261] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Refusing update from remote peer dd60fef562624217ba34314b3609e769: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:19.072510 16362 raft_consensus.cc:1261] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Refusing update from remote peer dd60fef562624217ba34314b3609e769: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:19.072988 16507 consensus_queue.cc:1035] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:19.073246 16490 consensus_queue.cc:1035] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:19.076146 16485 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: TxnStatusTablet state changed. Reason: New leader dd60fef562624217ba34314b3609e769. Latest consensus state: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.076419 16485 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:19.080154 16490 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.080433 16490 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:31:19.081498 16485 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.081751 16485 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P b81af8dff4cc40b4b416417ec5a0d2ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:19.089484 16484 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: TxnStatusTablet state changed. Reason: New leader dd60fef562624217ba34314b3609e769. Latest consensus state: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.089811 16484 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:19.090516 16482 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.090837 16482 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P dd60fef562624217ba34314b3609e769: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:31:19.092130 16484 tablet_replica.cc:439] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd60fef562624217ba34314b3609e769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d26132ae3cb4120ab42dc05268cb9f5" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44065 } } peers { permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 } } peers { permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 } } }
I20260806 20:31:19.092434 16484 tablet_replica.cc:442] T c9efe26937f646be87ccd63a4289ccb2 P 3d26132ae3cb4120ab42dc05268cb9f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:19.097826 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.090371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.13.149.65:44065)
0806 20:31:19.091044 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.091050 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.091068 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:31:19.091161 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.091169 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.091273 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.091422 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:19.091988 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.093281 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.095206 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.095839 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.095975 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.096425 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:19.097181 (+ 756us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:19.097343 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.097395 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.097491 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535}
I20260806 20:31:19.115626 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.109184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:46137 (local address 127.13.149.66:37409)
0806 20:31:19.109398 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.109404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.109813 (+ 409us) server_negotiation.cc:407] Connection header received
0806 20:31:19.109934 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.109939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.110037 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.110154 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:19.110609 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.111839 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.113461 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.114127 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.114264 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.114751 (+ 487us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:19.114971 (+ 220us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:19.115066 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.115220 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.115299 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 20:31:19.115612 16552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.109081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:37409 (local address 127.13.149.65:46137)
0806 20:31:19.109705 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:19.109720 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:19.109833 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:19.110162 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:19.110165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:19.110174 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:19.110456 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:19.110463 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.111995 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.111999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:19.113308 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:19.113320 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.114331 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.114336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:19.114454 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.114558 (+ 104us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:19.115074 (+ 516us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:19.115083 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 20:31:19.115147 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 20:31:19.115300 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":303,"threads_started":1}
I20260806 20:31:19.125811 16362 raft_consensus.cc:1261] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Refusing update from remote peer 3d26132ae3cb4120ab42dc05268cb9f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:19.126226 16146 raft_consensus.cc:1261] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Refusing update from remote peer 3d26132ae3cb4120ab42dc05268cb9f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:19.126504 16520 consensus_queue.cc:1035] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81af8dff4cc40b4b416417ec5a0d2ba" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:19.127296 16520 consensus_queue.cc:1035] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd60fef562624217ba34314b3609e769" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 37409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:19.141667 16494 mvcc.cc:205] Tried to move back new op lower bound from 7315653751293751296 to 7315653750416564224. Current Snapshot: MvccSnapshot[applied={T|T < 7315653751293751296}]
I20260806 20:31:19.168745 16560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.161532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44065 (local address 127.13.149.66:50815)
0806 20:31:19.162290 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:19.162307 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:19.162472 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:19.163214 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:19.163219 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:19.163236 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:19.163712 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:19.163724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.164945 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.164953 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:19.166216 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:19.166228 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.167145 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.167165 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:19.167381 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.167470 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:19.167958 (+ 488us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:19.167974 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 20:31:19.168070 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 20:31:19.168227 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":402,"threads_started":1}
I20260806 20:31:19.169281 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.161470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:50815 (local address 127.13.149.65:44065)
0806 20:31:19.161688 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.161697 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.162394 (+ 697us) server_negotiation.cc:407] Connection header received
0806 20:31:19.162615 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.162620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.162697 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.162801 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:19.163932 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.164823 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.166359 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.166935 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.167063 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.167689 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:19.167820 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:19.167929 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.168951 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.169033 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 20:31:19.205971 15657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:19.206245 15657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:19.210021 15657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 876f280121a04469b2b62db669acbcd1: Sending DeleteTablet for 3 replicas of tablet 75f01787f14b4e4ea36b09e6dfa5c6c2
I20260806 20:31:19.210830 15884 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:19 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:51220
I20260806 20:31:19.211131 16511 tablet_replica.cc:330] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: stopping tablet replica
I20260806 20:31:19.211226 16326 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:19 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:49360
I20260806 20:31:19.211325 16511 raft_consensus.cc:2229] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:31:19.211890 16511 raft_consensus.cc:2258] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:19.212093 16114 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:19 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41366
I20260806 20:31:19.212234 16513 tablet_replica.cc:330] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: stopping tablet replica
I20260806 20:31:19.212411 16510 tablet_replica.cc:330] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: stopping tablet replica
I20260806 20:31:19.212455 16513 raft_consensus.cc:2229] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:19.212604 16510 raft_consensus.cc:2229] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:19.212653 16513 raft_consensus.cc:2258] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:19.212989 16510 raft_consensus.cc:2258] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:19.214184 16513 ts_tablet_manager.cc:1905] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:19.214197 16510 ts_tablet_manager.cc:1905] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:19.217607 16511 ts_tablet_manager.cc:1905] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:19.227967 16511 ts_tablet_manager.cc:1918] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:19.227963 16513 ts_tablet_manager.cc:1918] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:19.228150 16511 log.cc:1196] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/75f01787f14b4e4ea36b09e6dfa5c6c2
I20260806 20:31:19.228186 16513 log.cc:1196] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/75f01787f14b4e4ea36b09e6dfa5c6c2
I20260806 20:31:19.228725 16511 ts_tablet_manager.cc:1939] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P 3d26132ae3cb4120ab42dc05268cb9f5: Deleting consensus metadata
I20260806 20:31:19.228741 16513 ts_tablet_manager.cc:1939] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P b81af8dff4cc40b4b416417ec5a0d2ba: Deleting consensus metadata
I20260806 20:31:19.229933 15633 catalog_manager.cc:4841] TS b81af8dff4cc40b4b416417ec5a0d2ba (127.13.149.67:38067): tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 (table test-table [id=79a7c6d97bf0485094954fa20bbd63cd]) successfully deleted
I20260806 20:31:19.229933 15638 catalog_manager.cc:4841] TS 3d26132ae3cb4120ab42dc05268cb9f5 (127.13.149.65:44065): tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 (table test-table [id=79a7c6d97bf0485094954fa20bbd63cd]) successfully deleted
I20260806 20:31:19.231559 16510 ts_tablet_manager.cc:1918] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:19.231752 16510 log.cc:1196] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/75f01787f14b4e4ea36b09e6dfa5c6c2
I20260806 20:31:19.232259 16510 ts_tablet_manager.cc:1939] T 75f01787f14b4e4ea36b09e6dfa5c6c2 P dd60fef562624217ba34314b3609e769: Deleting consensus metadata
I20260806 20:31:19.233654 15640 catalog_manager.cc:4841] TS dd60fef562624217ba34314b3609e769 (127.13.149.66:37409): tablet 75f01787f14b4e4ea36b09e6dfa5c6c2 (table test-table [id=79a7c6d97bf0485094954fa20bbd63cd]) successfully deleted
Aug 06 20:31:19 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048278, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:19.251231 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.231696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51244 (local address 127.13.149.65:44065)
0806 20:31:19.231957 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.231965 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.234615 (+ 2650us) server_negotiation.cc:407] Connection header received
0806 20:31:19.234888 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.234893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.234959 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.235088 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:19.236665 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.237626 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.239106 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.239654 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.239791 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.244283 (+ 4492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:19.244296 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:19.244313 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:19.244391 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:19.248025 (+ 3634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.248890 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.248901 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.248905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.249060 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.249458 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.249463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.249468 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.249946 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:19.250281 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.250580 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.250817 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260806 20:31:19.252107 15994 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51244
I20260806 20:31:19.268988 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.255312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34230 (local address 127.13.149.126:41817)
0806 20:31:19.255592 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.255598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.256396 (+ 798us) server_negotiation.cc:407] Connection header received
0806 20:31:19.256631 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.256637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.256718 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.256842 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:19.258539 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.259240 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.260474 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.261021 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.261158 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.263446 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:19.263452 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:19.263463 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:19.263496 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:19.266256 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.266918 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.266923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.266926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.267069 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.267437 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.267442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.267446 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.267722 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:19.267980 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.268306 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.268546 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
W20260806 20:31:19.269546 15657 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34230
I20260806 20:31:19.271842 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15779
I20260806 20:31:19.286827 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.273426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51248 (local address 127.13.149.65:44065)
0806 20:31:19.273620 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.273627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.274053 (+ 426us) server_negotiation.cc:407] Connection header received
0806 20:31:19.274228 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.274234 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.274310 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.274423 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:19.275534 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.276453 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.278023 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.278486 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.278563 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.280942 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:19.280949 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:19.280959 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:19.280998 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:19.283845 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.284470 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.284477 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.284480 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.284679 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.285107 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.285112 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.285116 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.285425 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:19.285679 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.286112 (+ 433us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.286366 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 20:31:19.287492 15994 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51248
W20260806 20:31:19.288089 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15779: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:19.288281 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15779
I20260806 20:31:19.322189 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16008
Aug 06 20:31:19 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048278, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:19.339965 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.323144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41390 (local address 127.13.149.66:37409)
0806 20:31:19.323323 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.323327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.323345 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:31:19.323537 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.323541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.323616 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.323698 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:19.325365 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.326156 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.328011 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.328465 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.328594 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.333698 (+ 5104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:19.333714 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:19.333737 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:19.333777 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:19.337056 (+ 3279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.337726 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.337737 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.337741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.337874 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.338275 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.338281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.338284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.338666 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:19.338963 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.339369 (+ 406us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.339607 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 20:31:19.340659 16209 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41390
W20260806 20:31:19.341348 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16008: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:19.341538 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16008
I20260806 20:31:19.371078 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16223
Aug 06 20:31:19 dist-test-slave-2kcd krb5kdc[15579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048278, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:19.386443 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:19.371836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49366 (local address 127.13.149.67:38067)
0806 20:31:19.372031 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:19.372038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:19.372134 (+ 96us) server_negotiation.cc:407] Connection header received
0806 20:31:19.372351 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:19.372355 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:19.372418 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:19.372542 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:19.373878 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.374622 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.375882 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:19.376416 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:19.376559 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:19.380909 (+ 4350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:19.380925 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:19.380942 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:19.380979 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:19.383634 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.384327 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.384335 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.384337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.384467 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:19.384892 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:19.384897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:19.384901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:19.385254 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:19.385611 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:19.385870 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 20:31:19.386127 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 20:31:19.387149 16427 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49366
W20260806 20:31:19.387763 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16223: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:19.387885 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16223
I20260806 20:31:19.413095 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15609
I20260806 20:31:19.414187 15725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:19.532495 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15609
2026-08-06T20:31:19Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4680 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:19 dist-test-slave-2kcd krb5kdc[16576](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:19 dist-test-slave-2kcd krb5kdc[16576](info): set up 2 sockets
Aug 06 20:31:19 dist-test-slave-2kcd krb5kdc[16576](info): commencing operation
krb5kdc: starting...
W20260806 20:31:20.835790 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:20 dist-test-slave-2kcd krb5kdc[16576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:21.038422 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42025
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:42025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:21.364702 16597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:21.365036 16597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:21.365216 16597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:21.372249 16597 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:21.372342 16597 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 20:31:21.372383 16597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:21.372435 16597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:21.372507 16597 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:21.372594 16597 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:21.382401 16597 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:42025
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:21.383579 16597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:21.384946 16597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:21.396397 16605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:21.396570 16612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:21.396479 16615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:21.397580 16597 server_base.cc:1034] running on GCE node
I20260806 20:31:21.398252 16597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:21.399488 16597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:21.400746 16597 hybrid_clock.cc:648] HybridClock initialized: now 1786048281400683 us; error 40 us; skew 500 ppm
I20260806 20:31:21.401129 16597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:21 dist-test-slave-2kcd krb5kdc[16576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:21.404266 16597 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:21.405654 16597 webserver.cc:460] Webserver started at http://127.13.149.126:45317/ using document root <none> and password file <none>
I20260806 20:31:21.406301 16597 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:21.406431 16597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:21.406734 16597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:21.409590 16597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "675491670fad47b6ac7c8958182de1cd"
format_stamp: "Formatted at 2026-08-06 20:31:21 on dist-test-slave-2kcd"
server_key: "cbec1f90b3d29375834dbddeea2883ed"
server_key_iv: "16902821befdbb29c49a4247e760840f"
server_key_version: "encryptionkey@0"
I20260806 20:31:21.410359 16597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "675491670fad47b6ac7c8958182de1cd"
format_stamp: "Formatted at 2026-08-06 20:31:21 on dist-test-slave-2kcd"
server_key: "cbec1f90b3d29375834dbddeea2883ed"
server_key_iv: "16902821befdbb29c49a4247e760840f"
server_key_version: "encryptionkey@0"
I20260806 20:31:21.415251 16597 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260806 20:31:21.418643 16626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:21.419845 16597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:31:21.419989 16597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "675491670fad47b6ac7c8958182de1cd"
format_stamp: "Formatted at 2026-08-06 20:31:21 on dist-test-slave-2kcd"
server_key: "cbec1f90b3d29375834dbddeea2883ed"
server_key_iv: "16902821befdbb29c49a4247e760840f"
server_key_version: "encryptionkey@0"
I20260806 20:31:21.420156 16597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:21.439234 16597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:21.443006 16597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:21.443233 16597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:21.465104 16597 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:42025
I20260806 20:31:21.465142 16716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:42025 every 8 connection(s)
I20260806 20:31:21.466378 16597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:21.469969 16717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:21.475504 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16597
I20260806 20:31:21.475733 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:21.476576 13909 external_mini_cluster.cc:1428] Setting key e1c635ba99f8b95fa96797f4c002a9c7
I20260806 20:31:21.481510 16717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Bootstrap starting.
I20260806 20:31:21.485299 16717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:21.486464 16717 log.cc:824] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:21.489605 16717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: No bootstrap required, opened a new log
Aug 06 20:31:21 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:21.497732 16717 raft_consensus.cc:348] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675491670fad47b6ac7c8958182de1cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42025 } }
I20260806 20:31:21.498109 16717 raft_consensus.cc:374] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:21.498214 16717 raft_consensus.cc:729] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675491670fad47b6ac7c8958182de1cd, State: Initialized, Role: FOLLOWER
I20260806 20:31:21.498765 16717 consensus_queue.cc:260] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675491670fad47b6ac7c8958182de1cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42025 } }
I20260806 20:31:21.499019 16717 raft_consensus.cc:388] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:21.499166 16717 raft_consensus.cc:482] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:21.499368 16717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:21.501623 16724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:21.478855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50380 (local address 127.13.149.126:42025)
0806 20:31:21.479819 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:21.479831 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:21.479879 (+ 48us) server_negotiation.cc:407] Connection header received
0806 20:31:21.481727 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:21.481750 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:21.482199 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:21.482522 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:21.484402 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:21.486008 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:21.487595 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:21.488298 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:21.488452 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:21.493408 (+ 4956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:21.493421 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:21.493434 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:21.493480 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:21.496886 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:21.497606 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:21.497615 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:21.497630 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:21.497800 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:21.498318 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:21.498344 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:21.498347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:21.499020 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:21.499369 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:21.499812 (+ 443us) server_negotiation.cc:299] Negotiation successful
0806 20:31:21.500287 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":498,"threads_started":1}
I20260806 20:31:21.502465 16717 raft_consensus.cc:504] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675491670fad47b6ac7c8958182de1cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42025 } }
I20260806 20:31:21.503027 16717 leader_election.cc:302] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 675491670fad47b6ac7c8958182de1cd; no voters:
I20260806 20:31:21.503764 16717 leader_election.cc:288] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:21.503912 16726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:21.505376 16726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [term 1 LEADER]: Becoming Leader. State: Replica: 675491670fad47b6ac7c8958182de1cd, State: Running, Role: LEADER
I20260806 20:31:21.505786 16717 sys_catalog.cc:564] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:21.505970 16726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675491670fad47b6ac7c8958182de1cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42025 } }
I20260806 20:31:21.510927 16727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "675491670fad47b6ac7c8958182de1cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675491670fad47b6ac7c8958182de1cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42025 } } }
I20260806 20:31:21.511456 16727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:21.512130 16728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 675491670fad47b6ac7c8958182de1cd. Latest consensus state: current_term: 1 leader_uuid: "675491670fad47b6ac7c8958182de1cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675491670fad47b6ac7c8958182de1cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42025 } } }
I20260806 20:31:21.512471 16728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd [sys.catalog]: This master's current role is: LEADER
W20260806 20:31:21.517491 16746 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:31:21.517638 16746 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:31:21.517800 16742 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:21.519639 16742 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:21.527962 16742 catalog_manager.cc:1347] Generated new cluster ID: 4283a6edeaca442da1c613bde4f4ce51
I20260806 20:31:21.528079 16742 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:21.538178 16742 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:21.539530 16742 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:21.551026 16742 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Generated new TSK 0
I20260806 20:31:21.551865 16742 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:21.605353 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42025
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:21.934994 16758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:21.935271 16758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:21.935449 16758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:21.942808 16758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:21.942994 16758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:21.943159 16758 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 20:31:21.943248 16758 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:31:21.943359 16758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:21.953300 16758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:42025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:21.954614 16758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:21.955971 16758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:21.970011 16767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:21.969935 16768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:21.970527 16770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:21.970901 16758 server_base.cc:1034] running on GCE node
I20260806 20:31:21.971508 16758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:21.972481 16758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:21.973693 16758 hybrid_clock.cc:648] HybridClock initialized: now 1786048281973655 us; error 32 us; skew 500 ppm
I20260806 20:31:21.974018 16758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:21 dist-test-slave-2kcd krb5kdc[16576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:21.977249 16758 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:21.978689 16758 webserver.cc:460] Webserver started at http://127.13.149.65:44329/ using document root <none> and password file <none>
I20260806 20:31:21.979372 16758 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:21.979530 16758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:21.979866 16758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:21.983014 16758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "5d9407f6e94b41ea8dbd3395ea8934bc"
format_stamp: "Formatted at 2026-08-06 20:31:21 on dist-test-slave-2kcd"
server_key: "502ef2f85f9c0d422eed3757e6336ec0"
server_key_iv: "fdf44b9d11fdaed17f2021ed1b06431c"
server_key_version: "encryptionkey@0"
I20260806 20:31:21.983805 16758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "5d9407f6e94b41ea8dbd3395ea8934bc"
format_stamp: "Formatted at 2026-08-06 20:31:21 on dist-test-slave-2kcd"
server_key: "502ef2f85f9c0d422eed3757e6336ec0"
server_key_iv: "fdf44b9d11fdaed17f2021ed1b06431c"
server_key_version: "encryptionkey@0"
I20260806 20:31:21.989136 16758 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 20:31:21.992523 16779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:21.993901 16758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:21.994091 16758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "5d9407f6e94b41ea8dbd3395ea8934bc"
format_stamp: "Formatted at 2026-08-06 20:31:21 on dist-test-slave-2kcd"
server_key: "502ef2f85f9c0d422eed3757e6336ec0"
server_key_iv: "fdf44b9d11fdaed17f2021ed1b06431c"
server_key_version: "encryptionkey@0"
I20260806 20:31:21.994297 16758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:22.007521 16758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:22.012037 16758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:22.012353 16758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:22.015377 16758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:22.015542 16758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:22.015686 16758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:22.015779 16758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:31:22 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:22.037426 16796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.016053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:44449 (local address 127.13.149.126:42025)
0806 20:31:22.017183 (+ 1130us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:22.017191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:22.017998 (+ 807us) server_negotiation.cc:407] Connection header received
0806 20:31:22.020050 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:22.020056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:22.020145 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:22.020279 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:22.022602 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.023533 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.026229 (+ 2696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.026656 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.026791 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.030765 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:22.030769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:22.030794 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:22.030843 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:22.034297 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.035026 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.035032 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.035036 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.035166 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.035619 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.035624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.035629 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.035904 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:22.036067 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:22.036814 (+ 747us) server_negotiation.cc:299] Negotiation successful
0806 20:31:22.037041 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":990,"thread_start_us":882,"threads_started":1}
I20260806 20:31:22.039006 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.016771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42025 (local address 127.13.149.65:44449)
0806 20:31:22.017812 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:22.017859 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:22.019770 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:22.020557 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:22.020572 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:22.021412 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:22.022414 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.022438 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.023693 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.023700 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.026027 (+ 2327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.026043 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.026904 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.026913 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.027136 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.027901 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:22.027923 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:22.030521 (+ 2598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:22.034434 (+ 3913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.034443 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.034459 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.034893 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.035278 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.035284 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.035288 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.035489 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.036043 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:22.036051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:22.036425 (+ 374us) client_negotiation.cc:769] Sending connection context
0806 20:31:22.036688 (+ 263us) client_negotiation.cc:240] Negotiation successful
0806 20:31:22.037292 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":415,"threads_started":1}
I20260806 20:31:22.060642 16796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.046499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:59061 (local address 127.13.149.126:42025)
0806 20:31:22.046905 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:22.046912 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:22.047288 (+ 376us) server_negotiation.cc:407] Connection header received
0806 20:31:22.047519 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:22.047525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:22.047598 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:22.047701 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:22.048650 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.049742 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.051774 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.052183 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.052328 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.054606 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:22.054613 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:22.054620 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:22.054660 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:22.057588 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.058500 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.058507 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.058512 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.058677 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.059148 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.059154 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.059159 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.059463 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:22.059626 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:22.060037 (+ 411us) server_negotiation.cc:299] Negotiation successful
0806 20:31:22.060265 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257}
I20260806 20:31:22.060740 16899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.046503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42025 (local address 127.13.149.65:59061)
0806 20:31:22.047159 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:22.047180 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:22.047356 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:22.047736 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:22.047742 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:22.048198 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:22.048488 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.048498 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.049921 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.049927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.051630 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.051643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.052379 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.052386 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.052562 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.053231 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:22.053249 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:22.054307 (+ 1058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:22.057725 (+ 3418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.057732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.057737 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.058316 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.058781 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.058785 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.058789 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.058961 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.059590 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:22.059595 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:22.059789 (+ 194us) client_negotiation.cc:769] Sending connection context
0806 20:31:22.059945 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 20:31:22.060292 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":412,"threads_started":1}
I20260806 20:31:22.072621 16758 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:44865
I20260806 20:31:22.072705 16982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:44865 every 8 connection(s)
I20260806 20:31:22.073939 16758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:22.076018 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16758
I20260806 20:31:22.076053 16983 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42025
I20260806 20:31:22.076252 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:22.076278 16983 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:22.077139 16983 heartbeater.cc:511] Master 127.13.149.126:42025 requested a full tablet report, sending...
I20260806 20:31:22.077188 13909 external_mini_cluster.cc:1428] Setting key 7a04d8d275b6276804c71d7dcc1944ea
I20260806 20:31:22.079409 16653 ts_manager.cc:194] Registered new tserver with Master: 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865)
I20260806 20:31:22.080902 16653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:44449
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:22.123631 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42025
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:22.477255 16987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:22.477602 16987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:22.477784 16987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:22.485824 16987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:22.485968 16987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:22.486114 16987 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 20:31:22.486207 16987 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:31:22.486318 16987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:22.496109 16987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:42025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:22.497522 16987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:22.498932 16987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:22.512487 17002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:22.512521 17005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:22.513176 17000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:22.514482 16987 server_base.cc:1034] running on GCE node
I20260806 20:31:22.515110 16987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:22.516132 16987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:22.517362 16987 hybrid_clock.cc:648] HybridClock initialized: now 1786048282517325 us; error 58 us; skew 500 ppm
I20260806 20:31:22.517688 16987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:22 dist-test-slave-2kcd krb5kdc[16576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048282, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:22.520925 16987 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:22.522395 16987 webserver.cc:460] Webserver started at http://127.13.149.66:39339/ using document root <none> and password file <none>
I20260806 20:31:22.523113 16987 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:22.523216 16987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:22.523483 16987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:22.526515 16987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "922b39b54970410baf2eca5b1b861c27"
format_stamp: "Formatted at 2026-08-06 20:31:22 on dist-test-slave-2kcd"
server_key: "5153e6d8fc2a097d73ed670958481bec"
server_key_iv: "eb62e8d9555734f58440ba4c7d425f4d"
server_key_version: "encryptionkey@0"
I20260806 20:31:22.527232 16987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "922b39b54970410baf2eca5b1b861c27"
format_stamp: "Formatted at 2026-08-06 20:31:22 on dist-test-slave-2kcd"
server_key: "5153e6d8fc2a097d73ed670958481bec"
server_key_iv: "eb62e8d9555734f58440ba4c7d425f4d"
server_key_version: "encryptionkey@0"
I20260806 20:31:22.532168 16987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:31:22.535492 17015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:22.536837 16987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:31:22.536983 16987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "922b39b54970410baf2eca5b1b861c27"
format_stamp: "Formatted at 2026-08-06 20:31:22 on dist-test-slave-2kcd"
server_key: "5153e6d8fc2a097d73ed670958481bec"
server_key_iv: "eb62e8d9555734f58440ba4c7d425f4d"
server_key_version: "encryptionkey@0"
I20260806 20:31:22.537147 16987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:22.553821 16987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:22.558135 16987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:22.558439 16987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:22.561127 16987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:22.561295 16987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:22.561462 16987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:22.561568 16987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:31:22 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048282, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:22.584658 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.562936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:40165 (local address 127.13.149.126:42025)
0806 20:31:22.563985 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:22.563993 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:22.564018 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:31:22.565718 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:22.565724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:22.565812 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:22.565951 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:22.568108 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.569509 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.572139 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.572685 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.572869 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.577449 (+ 4580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:22.577456 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:22.577461 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:22.577501 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:22.580458 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.581618 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.581626 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.581631 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.581808 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.582319 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.582324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.582328 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.582622 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:22.582788 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:22.583769 (+ 981us) server_negotiation.cc:299] Negotiation successful
0806 20:31:22.584060 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":913,"thread_start_us":805,"threads_started":1}
I20260806 20:31:22.585487 17027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.562340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42025 (local address 127.13.149.66:40165)
0806 20:31:22.563195 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:22.563244 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:22.565397 (+ 2153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:22.566203 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:22.566211 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:22.566999 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:22.567857 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.567909 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.569691 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.569700 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.571971 (+ 2271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.571990 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.572987 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.572995 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.573217 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.574050 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:22.574073 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:22.577170 (+ 3097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:22.580617 (+ 3447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.580630 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.580650 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.581479 (+ 829us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.581965 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.581969 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.581971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.582184 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.582768 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:22.582775 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:22.583279 (+ 504us) client_negotiation.cc:769] Sending connection context
0806 20:31:22.583610 (+ 331us) client_negotiation.cc:240] Negotiation successful
0806 20:31:22.584189 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":368,"threads_started":1}
I20260806 20:31:22.615149 16987 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:40767
I20260806 20:31:22.615162 17187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:40767 every 8 connection(s)
I20260806 20:31:22.616315 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.600008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42025 (local address 127.13.149.66:56595)
0806 20:31:22.600834 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:22.600861 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:22.601044 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:22.601479 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:22.601485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:22.602218 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:22.602748 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.602763 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.604144 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.604151 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.605865 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:22.605877 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.606711 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.606717 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:22.606907 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.607693 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:22.607724 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:22.609102 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:22.613462 (+ 4360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.613466 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.613469 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.613925 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.614458 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:22.614463 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:22.614469 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:22.614673 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:22.615464 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:22.615467 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:22.615625 (+ 158us) client_negotiation.cc:769] Sending connection context
0806 20:31:22.615755 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 20:31:22.616001 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":402,"threads_started":1}
I20260806 20:31:22.616514 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:22.600085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:56595 (local address 127.13.149.126:42025)
0806 20:31:22.600337 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:22.600345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:22.600971 (+ 626us) server_negotiation.cc:407] Connection header received
0806 20:31:22.601216 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:22.601224 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:22.601313 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:22.601456 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:22.602923 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.603981 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.606031 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:22.606500 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:22.606649 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:22.609350 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:22.609360 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:22.609368 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:22.609423 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:22.613329 (+ 3906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.614093 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.614100 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.614103 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.614276 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:22.614848 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:22.614855 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:22.614862 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:22.615347 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:22.615508 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:22.615915 (+ 407us) server_negotiation.cc:299] Negotiation successful
0806 20:31:22.616160 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 20:31:22.616977 16987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:22.620323 17188 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42025
I20260806 20:31:22.620587 17188 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:22.621299 17188 heartbeater.cc:511] Master 127.13.149.126:42025 requested a full tablet report, sending...
I20260806 20:31:22.622602 16653 ts_manager.cc:194] Registered new tserver with Master: 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767)
I20260806 20:31:22.623456 16653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:40165
I20260806 20:31:22.624904 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16987
I20260806 20:31:22.625104 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:22.625660 13909 external_mini_cluster.cc:1428] Setting key 7b79ccf2d600235759c74d23726231c6
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:22.672576 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42025
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:23.004869 17192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:23.005175 17192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:23.005281 17192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:23.012691 17192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:23.012850 17192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:23.012955 17192 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 20:31:23.013012 17192 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:31:23.013082 17192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:23.022878 17192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:42025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:23.024299 17192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:23.025645 17192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:23.038441 17197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:23.038755 17198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:23.038977 17201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:23.039690 17192 server_base.cc:1034] running on GCE node
I20260806 20:31:23.040241 17192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:23.041361 17192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:23.042565 17192 hybrid_clock.cc:648] HybridClock initialized: now 1786048283042499 us; error 56 us; skew 500 ppm
I20260806 20:31:23.042891 17192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:23 dist-test-slave-2kcd krb5kdc[16576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048283, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:23.046149 17192 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:23.047633 17192 webserver.cc:460] Webserver started at http://127.13.149.67:34047/ using document root <none> and password file <none>
I20260806 20:31:23.048311 17192 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:23.048417 17192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:23.048687 17192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:23.051586 17192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "3dc0adf432c24d92a8b46f64341208f5"
format_stamp: "Formatted at 2026-08-06 20:31:23 on dist-test-slave-2kcd"
server_key: "7f6ef3ea95c2ed0eaae7fadb4ef51046"
server_key_iv: "a06373aa67ca41f40d15c993f45e7f98"
server_key_version: "encryptionkey@0"
I20260806 20:31:23.052312 17192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "3dc0adf432c24d92a8b46f64341208f5"
format_stamp: "Formatted at 2026-08-06 20:31:23 on dist-test-slave-2kcd"
server_key: "7f6ef3ea95c2ed0eaae7fadb4ef51046"
server_key_iv: "a06373aa67ca41f40d15c993f45e7f98"
server_key_version: "encryptionkey@0"
I20260806 20:31:23.057474 17192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260806 20:31:23.060734 17208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:23.062099 17192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:31:23.062278 17192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "3dc0adf432c24d92a8b46f64341208f5"
format_stamp: "Formatted at 2026-08-06 20:31:23 on dist-test-slave-2kcd"
server_key: "7f6ef3ea95c2ed0eaae7fadb4ef51046"
server_key_iv: "a06373aa67ca41f40d15c993f45e7f98"
server_key_version: "encryptionkey@0"
I20260806 20:31:23.062479 17192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:23.076552 17192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:23.080956 17192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:23.081246 17192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:23.083693 16983 heartbeater.cc:503] Master 127.13.149.126:42025 was elected leader, sending a full tablet report...
I20260806 20:31:23.083985 17192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:23.084128 17192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:23.084337 17192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:23.084452 17192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:31:23 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048283, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:23.107892 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.084633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:56543 (local address 127.13.149.126:42025)
0806 20:31:23.084942 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.084948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.086478 (+ 1530us) server_negotiation.cc:407] Connection header received
0806 20:31:23.088835 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.088841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.088933 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.089065 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:23.090558 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.091680 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.094129 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.094692 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.094829 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.099945 (+ 5116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:23.099951 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:23.099956 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:23.099997 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:23.103629 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.104678 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.104686 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.104690 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.104928 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.105577 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.105585 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.105591 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.106062 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:23.106275 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.107267 (+ 992us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.107498 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181}
I20260806 20:31:23.109501 17221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.085200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42025 (local address 127.13.149.67:56543)
0806 20:31:23.086300 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.086356 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.088504 (+ 2148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.089244 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.089251 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.089784 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:23.090380 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.090397 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.091871 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.091880 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.093938 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.093950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.095164 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.095174 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.095479 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.096211 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:23.096238 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:23.099705 (+ 3467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:23.103812 (+ 4107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:23.103819 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:23.103842 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:23.104503 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:23.105108 (+ 605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:23.105113 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:23.105117 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:23.105436 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:23.106288 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:23.106297 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:23.106750 (+ 453us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.107150 (+ 400us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.107694 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"thread_start_us":508,"threads_started":1}
I20260806 20:31:23.128304 17192 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:40097
I20260806 20:31:23.128350 17396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:40097 every 8 connection(s)
I20260806 20:31:23.129796 17192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:23.132195 17397 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42025
I20260806 20:31:23.132454 17397 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:23.133177 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17192
I20260806 20:31:23.133390 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:23.133452 17397 heartbeater.cc:511] Master 127.13.149.126:42025 requested a full tablet report, sending...
I20260806 20:31:23.134020 13909 external_mini_cluster.cc:1428] Setting key 5544d9c0bfe8c72480cdd0f164df3a6c
I20260806 20:31:23.134414 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.118087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:41023 (local address 127.13.149.126:42025)
0806 20:31:23.118279 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.118286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.119172 (+ 886us) server_negotiation.cc:407] Connection header received
0806 20:31:23.119366 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.119370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.119434 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.119514 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:23.121418 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.122806 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.125094 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.125935 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.126081 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.128407 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:23.128414 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:23.128421 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:23.128462 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:23.131553 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.132260 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.132268 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.132272 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.132447 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.132860 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.132867 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.132870 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.133148 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:23.133403 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.133770 (+ 367us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.134001 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:31:23.134461 17363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.118241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42025 (local address 127.13.149.67:41023)
0806 20:31:23.119045 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.119071 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.119236 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.119585 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.119591 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.120370 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:23.121170 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.121191 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.122969 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.122977 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.124923 (+ 1946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.124941 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.126184 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.126194 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.126334 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.127074 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:23.127105 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:23.128208 (+ 1103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:23.131714 (+ 3506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:23.131717 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:23.131720 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:23.132157 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:23.132575 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:23.132579 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:23.132581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:23.132718 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:23.133276 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:23.133282 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:23.133499 (+ 217us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.133662 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.134001 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":495,"threads_started":1}
I20260806 20:31:23.135469 16653 ts_manager.cc:194] Registered new tserver with Master: 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097)
I20260806 20:31:23.136286 16653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:56543
I20260806 20:31:23.138732 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 20:31:23 dist-test-slave-2kcd krb5kdc[16576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 20:31:23 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:23.190640 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.176424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50384 (local address 127.13.149.126:42025)
0806 20:31:23.176685 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.176692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.176962 (+ 270us) server_negotiation.cc:407] Connection header received
0806 20:31:23.177190 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.177196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.177259 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.177367 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:23.178748 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.179526 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.180831 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.181244 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.181382 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.185313 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:23.185318 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:23.185322 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:23.185356 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:23.187928 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.188578 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.188585 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.188588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.188724 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.189191 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.189196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.189201 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.189477 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:23.189755 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.190071 (+ 316us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.190294 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 20:31:23.194726 16653 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:23.202011 16653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:23.231515 17425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.215841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41226 (local address 127.13.149.66:40767)
0806 20:31:23.221315 (+ 5474us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.221329 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.221366 (+ 37us) server_negotiation.cc:407] Connection header received
0806 20:31:23.221490 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.221501 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.221823 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.223071 (+ 1248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:23.224903 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.226425 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.229449 (+ 3024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.230325 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.230499 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.230724 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.231041 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.231212 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5246,"thread_start_us":5097,"threads_started":1}
I20260806 20:31:23.231876 17424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.215135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:40767 (local address 127.0.0.1:41226)
0806 20:31:23.216273 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.216290 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.216404 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.222146 (+ 5742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.222159 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.222202 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:23.222805 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.222823 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.226606 (+ 3783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.226615 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.229277 (+ 2662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.229294 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.230554 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.230561 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.230787 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.230826 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.230977 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.231175 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":999,"mutex_wait_us":1,"thread_start_us":9950,"threads_started":1}
I20260806 20:31:23.234928 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.214884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40856 (local address 127.13.149.67:40097)
0806 20:31:23.226104 (+ 11220us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.226112 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.226143 (+ 31us) server_negotiation.cc:407] Connection header received
0806 20:31:23.226226 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.226233 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.226442 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.226634 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:23.227482 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.229143 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.231747 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.233876 (+ 2129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.234023 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.234249 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.234465 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.234612 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11051,"thread_start_us":10866,"threads_started":1}
I20260806 20:31:23.234947 17421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.214572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:40097 (local address 127.0.0.1:40856)
0806 20:31:23.215306 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.215355 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.215523 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.226651 (+ 11128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.226661 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.226694 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:23.227250 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.227264 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.229298 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.229304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.231572 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.231586 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.234071 (+ 2485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.234078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.234250 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.234291 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.234403 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.234542 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":37,"thread_start_us":297,"threads_started":1}
I20260806 20:31:23.235459 17087 tablet_service.cc:1467] Processing CreateTablet for tablet 2dbada0f3b2046aa966da398b0a65156 (DEFAULT_TABLE table=test-table [id=855bd03687a6464283e277b8b6282af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:23.236989 17087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbada0f3b2046aa966da398b0a65156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.238201 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.216291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57488 (local address 127.13.149.65:44865)
0806 20:31:23.225656 (+ 9365us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.225669 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.225708 (+ 39us) server_negotiation.cc:407] Connection header received
0806 20:31:23.225815 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.225822 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.226056 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.226259 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:23.227020 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.228537 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.231394 (+ 2857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.237181 (+ 5787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.237330 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.237548 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.237746 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.237906 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9118,"thread_start_us":8391,"threads_started":1}
I20260806 20:31:23.238238 17423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.215703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44865 (local address 127.0.0.1:57488)
0806 20:31:23.225358 (+ 9655us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.225376 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.225504 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.226247 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.226251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.226277 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:23.226739 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.226754 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.228747 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.228752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.231210 (+ 2458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.231225 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.237377 (+ 6152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.237384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.237546 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.237588 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.237701 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.237828 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9520,"mutex_wait_us":157,"thread_start_us":785,"threads_started":1}
I20260806 20:31:23.238338 17289 tablet_service.cc:1467] Processing CreateTablet for tablet 2dbada0f3b2046aa966da398b0a65156 (DEFAULT_TABLE table=test-table [id=855bd03687a6464283e277b8b6282af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:23.239740 17289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbada0f3b2046aa966da398b0a65156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.241981 16873 tablet_service.cc:1467] Processing CreateTablet for tablet 2dbada0f3b2046aa966da398b0a65156 (DEFAULT_TABLE table=test-table [id=855bd03687a6464283e277b8b6282af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:23.243037 16873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbada0f3b2046aa966da398b0a65156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.251986 17428 tablet_bootstrap.cc:492] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Bootstrap starting.
I20260806 20:31:23.254004 17429 tablet_bootstrap.cc:492] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Bootstrap starting.
I20260806 20:31:23.256520 17428 tablet_bootstrap.cc:654] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.257076 17429 tablet_bootstrap.cc:654] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.257489 17430 tablet_bootstrap.cc:492] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Bootstrap starting.
I20260806 20:31:23.257917 17428 log.cc:824] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:23.258319 17429 log.cc:824] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:23.260748 17429 tablet_bootstrap.cc:492] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: No bootstrap required, opened a new log
I20260806 20:31:23.260964 17428 tablet_bootstrap.cc:492] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: No bootstrap required, opened a new log
I20260806 20:31:23.261106 17429 ts_tablet_manager.cc:1397] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260806 20:31:23.261196 17430 tablet_bootstrap.cc:654] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.261236 17428 ts_tablet_manager.cc:1397] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 20:31:23.262444 17430 log.cc:824] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:23.265407 17430 tablet_bootstrap.cc:492] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: No bootstrap required, opened a new log
I20260806 20:31:23.265738 17430 ts_tablet_manager.cc:1397] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.006s
I20260806 20:31:23.269240 17429 raft_consensus.cc:348] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.269595 17429 raft_consensus.cc:374] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.269726 17429 raft_consensus.cc:729] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc0adf432c24d92a8b46f64341208f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.270328 17429 consensus_queue.cc:260] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.271417 17397 heartbeater.cc:503] Master 127.13.149.126:42025 was elected leader, sending a full tablet report...
I20260806 20:31:23.271929 17429 ts_tablet_manager.cc:1428] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260806 20:31:23.273031 17428 raft_consensus.cc:348] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.273499 17428 raft_consensus.cc:374] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.273595 17428 raft_consensus.cc:729] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922b39b54970410baf2eca5b1b861c27, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.274170 17428 consensus_queue.cc:260] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.275295 17188 heartbeater.cc:503] Master 127.13.149.126:42025 was elected leader, sending a full tablet report...
I20260806 20:31:23.276614 17428 ts_tablet_manager.cc:1428] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260806 20:31:23.277345 17430 raft_consensus.cc:348] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.278482 17430 raft_consensus.cc:374] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.278600 17430 raft_consensus.cc:729] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.279120 17430 consensus_queue.cc:260] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.280766 17430 ts_tablet_manager.cc:1428] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent starting tablet: real 0.015s user 0.008s sys 0.004s
I20260806 20:31:23.319617 17438 raft_consensus.cc:482] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:23.319911 17438 raft_consensus.cc:504] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.321995 17438 leader_election.cc:288] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097), 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865)
W20260806 20:31:23.326354 16984 tablet.cc:2369] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:31:23.331251 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.322716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:47707 (local address 127.13.149.67:40097)
0806 20:31:23.322984 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.322990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.323928 (+ 938us) server_negotiation.cc:407] Connection header received
0806 20:31:23.324148 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.324153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.324238 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.324321 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:23.325019 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.325845 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.328754 (+ 2909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.330058 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.330242 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.330307 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.330853 (+ 546us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.330997 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 20:31:23.331259 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.323381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:39757 (local address 127.13.149.65:44865)
0806 20:31:23.324168 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.324174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.324192 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:31:23.324278 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.324281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.324380 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.324478 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:23.325306 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.326101 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.328766 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.330059 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.330232 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.330307 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.330853 (+ 546us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.330990 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 20:31:23.331558 17441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.323071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44865 (local address 127.13.149.66:39757)
0806 20:31:23.324000 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.324024 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.324143 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.324609 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.324612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.324633 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:23.325119 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.325132 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.326273 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.326280 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.328586 (+ 2306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.328601 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.330340 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.330348 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.330580 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.330706 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.330806 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.331047 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"mutex_wait_us":154,"thread_start_us":472,"threads_started":1}
I20260806 20:31:23.331575 17440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.322211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:40097 (local address 127.13.149.66:47707)
0806 20:31:23.323795 (+ 1584us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.323818 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.323998 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.324368 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.324373 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.324399 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:23.324850 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.324864 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.325983 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.325989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.328587 (+ 2598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.328601 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.330352 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.330356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.330581 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.330703 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.330806 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.331048 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1434,"mutex_wait_us":247,"thread_start_us":427,"threads_started":1}
I20260806 20:31:23.332634 16914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbada0f3b2046aa966da398b0a65156" candidate_uuid: "922b39b54970410baf2eca5b1b861c27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" is_pre_election: true
I20260806 20:31:23.332628 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbada0f3b2046aa966da398b0a65156" candidate_uuid: "922b39b54970410baf2eca5b1b861c27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5" is_pre_election: true
I20260806 20:31:23.333191 16914 raft_consensus.cc:2454] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922b39b54970410baf2eca5b1b861c27 in term 0.
I20260806 20:31:23.333211 17317 raft_consensus.cc:2454] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922b39b54970410baf2eca5b1b861c27 in term 0.
I20260806 20:31:23.333849 17017 leader_election.cc:302] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d9407f6e94b41ea8dbd3395ea8934bc, 922b39b54970410baf2eca5b1b861c27; no voters:
I20260806 20:31:23.334292 17438 raft_consensus.cc:2781] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:23.334465 17438 raft_consensus.cc:482] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:23.334594 17438 raft_consensus.cc:3037] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:23.336874 17438 raft_consensus.cc:504] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.337517 17438 leader_election.cc:288] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [CANDIDATE]: Term 1 election: Requested vote from peers 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097), 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865)
I20260806 20:31:23.337987 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbada0f3b2046aa966da398b0a65156" candidate_uuid: "922b39b54970410baf2eca5b1b861c27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5"
I20260806 20:31:23.338073 16914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbada0f3b2046aa966da398b0a65156" candidate_uuid: "922b39b54970410baf2eca5b1b861c27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc"
I20260806 20:31:23.338212 17317 raft_consensus.cc:3037] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:23.338267 16914 raft_consensus.cc:3037] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:23.341666 17317 raft_consensus.cc:2454] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922b39b54970410baf2eca5b1b861c27 in term 1.
I20260806 20:31:23.341666 16914 raft_consensus.cc:2454] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922b39b54970410baf2eca5b1b861c27 in term 1.
I20260806 20:31:23.342082 17017 leader_election.cc:302] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc0adf432c24d92a8b46f64341208f5, 922b39b54970410baf2eca5b1b861c27; no voters:
I20260806 20:31:23.342355 17438 raft_consensus.cc:2781] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:23.342811 17438 raft_consensus.cc:686] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 1 LEADER]: Becoming Leader. State: Replica: 922b39b54970410baf2eca5b1b861c27, State: Running, Role: LEADER
I20260806 20:31:23.343384 17438 consensus_queue.cc:237] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } }
I20260806 20:31:23.348019 16657 catalog_manager.cc:5495] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 922b39b54970410baf2eca5b1b861c27 (127.13.149.66). New cstate: current_term: 1 leader_uuid: "922b39b54970410baf2eca5b1b861c27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260806 20:31:23.369114 17189 tablet.cc:2369] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:31:23.381963 17398 tablet.cc:2369] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 20:31:23 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:23.414609 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.395349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42025 (local address 127.0.0.1:50386)
0806 20:31:23.395973 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.395989 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.396115 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.396416 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.396419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.397160 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:23.397448 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.397457 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.398498 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.398506 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.399554 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.399566 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.400287 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.400292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.400414 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.406821 (+ 6407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:23.406839 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:23.409402 (+ 2563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:23.412242 (+ 2840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:23.412252 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:23.412258 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:23.412718 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:23.413147 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:23.413150 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:23.413153 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:23.413291 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:23.413780 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:23.413786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:23.413947 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.414094 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.414280 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":337,"threads_started":1}
I20260806 20:31:23.414631 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.395248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50386 (local address 127.13.149.126:42025)
0806 20:31:23.395479 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.395487 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.396077 (+ 590us) server_negotiation.cc:407] Connection header received
0806 20:31:23.396215 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.396219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.396290 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.396375 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:23.397577 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.398360 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.399689 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.400118 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.400225 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.409572 (+ 9347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:23.409576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:23.409580 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:23.409608 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:23.412120 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.412878 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.412882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.412884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.413047 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:23.413391 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:23.413394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:23.413396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:23.413666 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:23.413797 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.414210 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.414373 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 20:31:23.419641 16657 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:50386:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 20:31:23.420718 16657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:23.427325 16873 tablet_service.cc:1467] Processing CreateTablet for tablet 636f8b7f22114f2086d81d2d8a58e4c9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f1a0e4988374d2d8f3f5534046ad631]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:31:23.427515 17289 tablet_service.cc:1467] Processing CreateTablet for tablet 636f8b7f22114f2086d81d2d8a58e4c9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f1a0e4988374d2d8f3f5534046ad631]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:31:23.427429 17087 tablet_service.cc:1467] Processing CreateTablet for tablet 636f8b7f22114f2086d81d2d8a58e4c9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f1a0e4988374d2d8f3f5534046ad631]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:31:23.428340 17087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 636f8b7f22114f2086d81d2d8a58e4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.428336 16873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 636f8b7f22114f2086d81d2d8a58e4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.428334 17289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 636f8b7f22114f2086d81d2d8a58e4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.434201 17428 tablet_bootstrap.cc:492] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: Bootstrap starting.
I20260806 20:31:23.435629 17430 tablet_bootstrap.cc:492] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: Bootstrap starting.
I20260806 20:31:23.435653 17428 tablet_bootstrap.cc:654] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.435815 17429 tablet_bootstrap.cc:492] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: Bootstrap starting.
I20260806 20:31:23.437455 17430 tablet_bootstrap.cc:654] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.437603 17429 tablet_bootstrap.cc:654] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.438220 17428 tablet_bootstrap.cc:492] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: No bootstrap required, opened a new log
I20260806 20:31:23.438367 17428 ts_tablet_manager.cc:1397] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260806 20:31:23.439147 17428 raft_consensus.cc:348] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.439397 17428 raft_consensus.cc:374] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.439503 17428 raft_consensus.cc:729] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922b39b54970410baf2eca5b1b861c27, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.439740 17428 consensus_queue.cc:260] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.439965 17430 tablet_bootstrap.cc:492] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: No bootstrap required, opened a new log
I20260806 20:31:23.439990 17429 tablet_bootstrap.cc:492] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: No bootstrap required, opened a new log
I20260806 20:31:23.440112 17430 ts_tablet_manager.cc:1397] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260806 20:31:23.440117 17429 ts_tablet_manager.cc:1397] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 20:31:23.440366 17428 ts_tablet_manager.cc:1428] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 20:31:23.440694 17438 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.441046 17438 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:23.440932 17430 raft_consensus.cc:348] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.441190 17430 raft_consensus.cc:374] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.441284 17430 raft_consensus.cc:729] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.441509 17430 consensus_queue.cc:260] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.441841 17429 raft_consensus.cc:348] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.442118 17429 raft_consensus.cc:374] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.442152 17430 ts_tablet_manager.cc:1428] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 20:31:23.442210 17429 raft_consensus.cc:729] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc0adf432c24d92a8b46f64341208f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.442015 17439 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.442461 17439 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:23.442457 17429 consensus_queue.cc:260] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.443081 17429 ts_tablet_manager.cc:1428] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 20:31:23.443048 17437 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.443442 17437 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:23.678467 17439 raft_consensus.cc:482] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:23.678699 17439 raft_consensus.cc:504] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.680397 17439 leader_election.cc:288] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767), 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097)
I20260806 20:31:23.687450 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.680907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:34255 (local address 127.13.149.67:40097)
0806 20:31:23.681115 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.681122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.681942 (+ 820us) server_negotiation.cc:407] Connection header received
0806 20:31:23.682133 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.682150 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.682224 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.682325 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:23.682961 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.683711 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.685591 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.686436 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.686552 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.686601 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.687036 (+ 435us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.687197 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:31:23.687673 17425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.680997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:48077 (local address 127.13.149.66:40767)
0806 20:31:23.681264 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.681273 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.681735 (+ 462us) server_negotiation.cc:407] Connection header received
0806 20:31:23.681916 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.681923 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.682004 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.682101 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:23.682782 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.683626 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.685629 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.686663 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.686827 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.686893 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.687210 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.687348 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 20:31:23.687654 17459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.680714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:40097 (local address 127.13.149.65:34255)
0806 20:31:23.681801 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.681835 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.681982 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.682355 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.682358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.682381 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:23.682786 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.682798 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.683859 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.683863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.685424 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.685440 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.686648 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.686654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.686850 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.686883 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.686982 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.687070 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"mutex_wait_us":39,"thread_start_us":541,"threads_started":1}
I20260806 20:31:23.687739 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.680662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:40767 (local address 127.13.149.65:48077)
0806 20:31:23.681602 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.681626 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.681764 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.682131 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.682135 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.682172 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:23.682607 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.682620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.683764 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.683771 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.685448 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.685461 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.686867 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.686871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.687032 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.687064 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.687206 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.687334 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"mutex_wait_us":44,"thread_start_us":791,"threads_started":1}
I20260806 20:31:23.688503 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "636f8b7f22114f2086d81d2d8a58e4c9" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5" is_pre_election: true
I20260806 20:31:23.688838 17317 raft_consensus.cc:2454] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 0.
I20260806 20:31:23.688877 17125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "636f8b7f22114f2086d81d2d8a58e4c9" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27" is_pre_election: true
I20260806 20:31:23.689333 17125 raft_consensus.cc:2454] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 0.
I20260806 20:31:23.689347 16780 leader_election.cc:302] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc0adf432c24d92a8b46f64341208f5, 5d9407f6e94b41ea8dbd3395ea8934bc; no voters:
I20260806 20:31:23.689738 17439 raft_consensus.cc:2781] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:23.689893 17439 raft_consensus.cc:482] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:23.690006 17439 raft_consensus.cc:3037] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:23.692166 17439 raft_consensus.cc:504] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.692750 17439 leader_election.cc:288] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 election: Requested vote from peers 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767), 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097)
I20260806 20:31:23.693194 17125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "636f8b7f22114f2086d81d2d8a58e4c9" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27"
I20260806 20:31:23.693267 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "636f8b7f22114f2086d81d2d8a58e4c9" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5"
I20260806 20:31:23.693414 17125 raft_consensus.cc:3037] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:23.693460 17317 raft_consensus.cc:3037] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:23.696352 17317 raft_consensus.cc:2454] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 1.
I20260806 20:31:23.696405 17125 raft_consensus.cc:2454] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 1.
I20260806 20:31:23.696841 16782 leader_election.cc:302] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3dc0adf432c24d92a8b46f64341208f5, 5d9407f6e94b41ea8dbd3395ea8934bc, 922b39b54970410baf2eca5b1b861c27; no voters:
I20260806 20:31:23.697180 17439 raft_consensus.cc:2781] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:23.697669 17439 raft_consensus.cc:686] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 LEADER]: Becoming Leader. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Running, Role: LEADER
I20260806 20:31:23.698149 17439 consensus_queue.cc:237] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.701520 17460 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: TxnStatusTablet state changed. Reason: New leader 5d9407f6e94b41ea8dbd3395ea8934bc. Latest consensus state: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.701861 17460 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:31:23.702647 17463 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 20:31:23.702941 17463 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 20:31:23.703474 16657 catalog_manager.cc:5495] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65). New cstate: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } health_report { overall_health: UNKNOWN } } }
I20260806 20:31:23.734545 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.728321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57490 (local address 127.13.149.65:44865)
0806 20:31:23.728502 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.728506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.728579 (+ 73us) server_negotiation.cc:407] Connection header received
0806 20:31:23.728919 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.728923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.729001 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.729121 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:23.729569 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.730371 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.732316 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.732764 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.732923 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.733464 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:23.733961 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:23.734068 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.734221 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.734288 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 20:31:23.734685 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.728146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44865 (local address 127.0.0.1:57490)
0806 20:31:23.728470 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.728493 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.728684 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.729181 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.729188 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.729203 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:23.729428 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.729442 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.730510 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.730516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.732150 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.732170 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.732976 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.732983 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.733195 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.733269 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:23.734076 (+ 807us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:23.734099 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.734193 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.734351 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260806 20:31:23.742504 17125 raft_consensus.cc:1261] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Refusing update from remote peer 5d9407f6e94b41ea8dbd3395ea8934bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:23.742609 17317 raft_consensus.cc:1261] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Refusing update from remote peer 5d9407f6e94b41ea8dbd3395ea8934bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:23.743476 17439 consensus_queue.cc:1035] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:23.743863 17460 consensus_queue.cc:1035] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:23.753000 17438 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: TxnStatusTablet state changed. Reason: New leader 5d9407f6e94b41ea8dbd3395ea8934bc. Latest consensus state: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.753427 17438 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:23.757745 17437 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: TxnStatusTablet state changed. Reason: New leader 5d9407f6e94b41ea8dbd3395ea8934bc. Latest consensus state: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.758033 17437 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:23.758471 17466 mvcc.cc:205] Tried to move back new op lower bound from 7315653770198343680 to 7315653770031456256. Current Snapshot: MvccSnapshot[applied={T|T < 7315653770198343680}]
I20260806 20:31:23.760358 17439 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.760833 17439 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:31:23.761530 17469 mvcc.cc:205] Tried to move back new op lower bound from 7315653770198343680 to 7315653770031456256. Current Snapshot: MvccSnapshot[applied={T|T < 7315653770198343680}]
I20260806 20:31:23.761418 17439 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.762005 17439 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 5d9407f6e94b41ea8dbd3395ea8934bc: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:31:23.778821 17437 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.779192 17437 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 3dc0adf432c24d92a8b46f64341208f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:23.798305 17438 tablet_replica.cc:439] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } } }
I20260806 20:31:23.798630 17438 tablet_replica.cc:442] T 636f8b7f22114f2086d81d2d8a58e4c9 P 922b39b54970410baf2eca5b1b861c27: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:31:23.800441 17425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.783298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41238 (local address 127.13.149.66:40767)
0806 20:31:23.783535 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.783544 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.789544 (+ 6000us) server_negotiation.cc:407] Connection header received
0806 20:31:23.789966 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.789975 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.790140 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.790291 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:23.791210 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.792701 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.796255 (+ 3554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.796686 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.796758 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.797366 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:23.798135 (+ 769us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:23.798284 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.800037 (+ 1753us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.800126 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:31:23.817169 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.811255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:56095 (local address 127.13.149.65:44865)
0806 20:31:23.811488 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.811493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.811754 (+ 261us) server_negotiation.cc:407] Connection header received
0806 20:31:23.811938 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.811943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.812015 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.812090 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:23.812648 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.813441 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.815465 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.815847 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.815935 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.816467 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:23.816558 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:23.816628 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.816873 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.816932 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:31:23.817345 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.811074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44865 (local address 127.13.149.66:56095)
0806 20:31:23.811650 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.811671 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.811815 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.812133 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.812138 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.812152 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:23.812503 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.812515 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.813576 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.813581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.815325 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.815339 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.816017 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.816024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.816216 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.816280 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:23.816666 (+ 386us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:23.816678 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.816805 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.816957 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":262,"threads_started":1}
I20260806 20:31:23.827417 17311 raft_consensus.cc:1261] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Refusing update from remote peer 922b39b54970410baf2eca5b1b861c27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:23.827725 16914 raft_consensus.cc:1261] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Refusing update from remote peer 922b39b54970410baf2eca5b1b861c27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:23.828454 17443 consensus_queue.cc:1035] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:23.828946 17438 consensus_queue.cc:1035] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:23.834141 17472 mvcc.cc:205] Tried to move back new op lower bound from 7315653770550915072 to 7315653768578887680. Current Snapshot: MvccSnapshot[applied={T|T < 7315653770550915072}]
I20260806 20:31:23.875490 17425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.868812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:40015 (local address 127.13.149.66:40767)
0806 20:31:23.869014 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:23.869024 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:23.869783 (+ 759us) server_negotiation.cc:407] Connection header received
0806 20:31:23.869996 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:23.870001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:23.870101 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:23.870210 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:23.870895 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.871608 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.873594 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.874023 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.874190 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.874700 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:23.874842 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:23.874951 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:23.875123 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 20:31:23.875209 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 20:31:23.876019 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:23.868725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:40767 (local address 127.13.149.65:40015)
0806 20:31:23.869660 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:23.869683 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:23.869838 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:23.870230 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:23.870235 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:23.870250 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:23.870728 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.870744 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.871747 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.871752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.873452 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:23.873473 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:23.874231 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:23.874240 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:23.874408 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:23.874500 (+ 92us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:23.874972 (+ 472us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:23.874996 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 20:31:23.875085 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 20:31:23.875229 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":592,"threads_started":1}
I20260806 20:31:23.917634 16657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:23.917946 16657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:23.922029 16657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Sending DeleteTablet for 3 replicas of tablet 2dbada0f3b2046aa966da398b0a65156
I20260806 20:31:23.923211 17289 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dbada0f3b2046aa966da398b0a65156 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:23 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:40856
I20260806 20:31:23.923748 17087 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dbada0f3b2046aa966da398b0a65156 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:23 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41226
I20260806 20:31:23.924082 16873 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dbada0f3b2046aa966da398b0a65156 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:23 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:57488
I20260806 20:31:23.929731 16657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:23.931658 16657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:23.934631 17510 tablet_replica.cc:330] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: stopping tablet replica
I20260806 20:31:23.935117 17510 raft_consensus.cc:2229] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:31:23.935835 17510 raft_consensus.cc:2258] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:23.942106 17510 ts_tablet_manager.cc:1905] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:23.944239 16872 tablet_service.cc:1467] Processing CreateTablet for tablet a9c84a42a0054646974f2f4c205be441 (DEFAULT_TABLE table=test-table [id=fa3754b078ad41578bd52779e9c31a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:23.944471 17087 tablet_service.cc:1467] Processing CreateTablet for tablet a9c84a42a0054646974f2f4c205be441 (DEFAULT_TABLE table=test-table [id=fa3754b078ad41578bd52779e9c31a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:23.944766 16872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9c84a42a0054646974f2f4c205be441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.944968 17087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9c84a42a0054646974f2f4c205be441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.951241 17510 ts_tablet_manager.cc:1918] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:23.951426 17510 log.cc:1196] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/2dbada0f3b2046aa966da398b0a65156
I20260806 20:31:23.952320 17288 tablet_service.cc:1467] Processing CreateTablet for tablet a9c84a42a0054646974f2f4c205be441 (DEFAULT_TABLE table=test-table [id=fa3754b078ad41578bd52779e9c31a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:23.952827 17288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9c84a42a0054646974f2f4c205be441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:23.953136 17510 ts_tablet_manager.cc:1939] T 2dbada0f3b2046aa966da398b0a65156 P 922b39b54970410baf2eca5b1b861c27: Deleting consensus metadata
I20260806 20:31:23.955955 16630 catalog_manager.cc:4841] TS 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767): tablet 2dbada0f3b2046aa966da398b0a65156 (table test-table [id=855bd03687a6464283e277b8b6282af1]) successfully deleted
I20260806 20:31:23.966429 17516 tablet_bootstrap.cc:492] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: Bootstrap starting.
I20260806 20:31:23.967728 17513 tablet_replica.cc:330] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: stopping tablet replica
I20260806 20:31:23.968328 17513 raft_consensus.cc:2229] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:23.968811 17513 raft_consensus.cc:2258] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:23.971254 17516 tablet_bootstrap.cc:654] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.971796 17509 tablet_replica.cc:330] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: stopping tablet replica
I20260806 20:31:23.972289 17509 raft_consensus.cc:2229] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:23.972874 17509 raft_consensus.cc:2258] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:23.973276 17518 tablet_bootstrap.cc:492] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: Bootstrap starting.
I20260806 20:31:23.975142 17518 tablet_bootstrap.cc:654] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.975142 17513 ts_tablet_manager.cc:1905] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:23.976336 17515 tablet_bootstrap.cc:492] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: Bootstrap starting.
I20260806 20:31:23.977042 17509 ts_tablet_manager.cc:1905] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:23.979689 17516 tablet_bootstrap.cc:492] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: No bootstrap required, opened a new log
I20260806 20:31:23.979856 17516 ts_tablet_manager.cc:1397] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260806 20:31:23.980715 17516 raft_consensus.cc:348] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.981014 17516 raft_consensus.cc:374] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.981129 17516 raft_consensus.cc:729] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922b39b54970410baf2eca5b1b861c27, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.981382 17516 consensus_queue.cc:260] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.982259 17518 tablet_bootstrap.cc:492] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: No bootstrap required, opened a new log
I20260806 20:31:23.982425 17518 ts_tablet_manager.cc:1397] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 20:31:23.983243 17516 ts_tablet_manager.cc:1428] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:23.983330 17518 raft_consensus.cc:348] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.983597 17518 raft_consensus.cc:374] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.983713 17518 raft_consensus.cc:729] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc0adf432c24d92a8b46f64341208f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.986110 17518 consensus_queue.cc:260] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.986613 17515 tablet_bootstrap.cc:654] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:23.989506 17509 ts_tablet_manager.cc:1918] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:23.989722 17509 log.cc:1196] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/2dbada0f3b2046aa966da398b0a65156
I20260806 20:31:23.990332 17509 ts_tablet_manager.cc:1939] T 2dbada0f3b2046aa966da398b0a65156 P 3dc0adf432c24d92a8b46f64341208f5: Deleting consensus metadata
I20260806 20:31:23.991354 17518 ts_tablet_manager.cc:1428] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260806 20:31:23.992295 16627 catalog_manager.cc:4841] TS 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097): tablet 2dbada0f3b2046aa966da398b0a65156 (table test-table [id=855bd03687a6464283e277b8b6282af1]) successfully deleted
I20260806 20:31:23.995615 17515 tablet_bootstrap.cc:492] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: No bootstrap required, opened a new log
I20260806 20:31:23.995810 17515 ts_tablet_manager.cc:1397] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260806 20:31:23.996851 17515 raft_consensus.cc:348] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:23.997177 17515 raft_consensus.cc:374] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:23.997315 17515 raft_consensus.cc:729] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Initialized, Role: FOLLOWER
I20260806 20:31:23.997673 17515 consensus_queue.cc:260] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:24.000066 17513 ts_tablet_manager.cc:1918] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:24.000427 17513 log.cc:1196] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/2dbada0f3b2046aa966da398b0a65156
I20260806 20:31:24.000932 17515 ts_tablet_manager.cc:1428] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260806 20:31:24.001178 17513 ts_tablet_manager.cc:1939] T 2dbada0f3b2046aa966da398b0a65156 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting consensus metadata
I20260806 20:31:24.003145 16627 catalog_manager.cc:4841] TS 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865): tablet 2dbada0f3b2046aa966da398b0a65156 (table test-table [id=855bd03687a6464283e277b8b6282af1]) successfully deleted
I20260806 20:31:24.025252 17480 raft_consensus.cc:482] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:24.025513 17480 raft_consensus.cc:504] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:24.026506 17480 leader_election.cc:288] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767), 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097)
I20260806 20:31:24.027161 17125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c84a42a0054646974f2f4c205be441" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27" is_pre_election: true
I20260806 20:31:24.027241 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c84a42a0054646974f2f4c205be441" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5" is_pre_election: true
I20260806 20:31:24.027472 17125 raft_consensus.cc:2454] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 0.
I20260806 20:31:24.027530 17311 raft_consensus.cc:2454] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 0.
I20260806 20:31:24.027990 16780 leader_election.cc:302] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc0adf432c24d92a8b46f64341208f5, 5d9407f6e94b41ea8dbd3395ea8934bc; no voters:
I20260806 20:31:24.028366 17480 raft_consensus.cc:2781] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:24.028514 17480 raft_consensus.cc:482] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:24.028640 17480 raft_consensus.cc:3037] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:24.032167 17480 raft_consensus.cc:504] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:24.033376 17125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c84a42a0054646974f2f4c205be441" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27"
I20260806 20:31:24.033448 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c84a42a0054646974f2f4c205be441" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5"
I20260806 20:31:24.033603 17125 raft_consensus.cc:3037] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:24.033694 17311 raft_consensus.cc:3037] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:24.036859 17125 raft_consensus.cc:2454] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 1.
I20260806 20:31:24.037002 17311 raft_consensus.cc:2454] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 1.
I20260806 20:31:24.037446 16782 leader_election.cc:302] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d9407f6e94b41ea8dbd3395ea8934bc, 922b39b54970410baf2eca5b1b861c27; no voters:
I20260806 20:31:24.037765 17439 raft_consensus.cc:2781] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:24.037915 17439 raft_consensus.cc:686] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 LEADER]: Becoming Leader. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Running, Role: LEADER
I20260806 20:31:24.038208 17439 consensus_queue.cc:237] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:24.039798 17480 leader_election.cc:288] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 election: Requested vote from peers 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767), 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097)
I20260806 20:31:24.042371 16651 catalog_manager.cc:5495] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65). New cstate: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } health_report { overall_health: UNKNOWN } } }
I20260806 20:31:24.083750 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:24.076692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57506 (local address 127.13.149.65:44865)
0806 20:31:24.076898 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:24.076904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:24.076921 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:31:24.076981 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:24.076986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:24.077065 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:24.077152 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:24.077713 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:24.078993 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:24.081006 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:24.081770 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:24.081904 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:24.082523 (+ 619us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:24.082685 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:24.082762 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:24.083361 (+ 599us) server_negotiation.cc:299] Negotiation successful
0806 20:31:24.083444 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 20:31:24.100375 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:24.093746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44865 (local address 127.13.149.65:49577)
0806 20:31:24.093965 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:24.093991 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:24.094133 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:24.094754 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:24.094759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:24.094771 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:24.094938 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:24.094948 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:24.096373 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:24.096378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:24.098062 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:24.098076 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:24.099175 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:24.099181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:24.099360 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:24.099400 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:24.099796 (+ 396us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:24.099807 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 20:31:24.099888 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 20:31:24.100042 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 20:31:24.101063 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:24.094133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:49577 (local address 127.13.149.65:44865)
0806 20:31:24.094287 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:24.094292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:24.094309 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:31:24.094376 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:24.094381 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:24.094474 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:24.094570 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:24.095065 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:24.096228 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:24.098278 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:24.098963 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:24.099078 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:24.099540 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:24.099684 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:24.099762 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:24.100713 (+ 951us) server_negotiation.cc:299] Negotiation successful
0806 20:31:24.100807 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 20:31:24.117719 17311 raft_consensus.cc:1261] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Refusing update from remote peer 5d9407f6e94b41ea8dbd3395ea8934bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:24.117697 17125 raft_consensus.cc:1261] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Refusing update from remote peer 5d9407f6e94b41ea8dbd3395ea8934bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:24.118386 17460 consensus_queue.cc:1035] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:24.118903 17460 consensus_queue.cc:1035] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 20:31:24.160604 17466 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 20:31:25.774663 16657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:25.775017 16657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:25.780339 16657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Sending DeleteTablet for 3 replicas of tablet a9c84a42a0054646974f2f4c205be441
I20260806 20:31:25.781157 16872 tablet_service.cc:1514] Processing DeleteTablet for tablet a9c84a42a0054646974f2f4c205be441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:25 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:57488
I20260806 20:31:25.781308 17087 tablet_service.cc:1514] Processing DeleteTablet for tablet a9c84a42a0054646974f2f4c205be441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:25 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41226
I20260806 20:31:25.781359 17289 tablet_service.cc:1514] Processing DeleteTablet for tablet a9c84a42a0054646974f2f4c205be441 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:25 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:40856
I20260806 20:31:25.798128 17559 tablet_replica.cc:330] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: stopping tablet replica
I20260806 20:31:25.798619 17563 tablet_replica.cc:330] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: stopping tablet replica
I20260806 20:31:25.798642 17559 raft_consensus.cc:2229] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:31:25.799036 17563 raft_consensus.cc:2229] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:25.799394 17563 raft_consensus.cc:2258] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:25.799856 17559 raft_consensus.cc:2258] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:25.801457 17563 ts_tablet_manager.cc:1905] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:25.801882 17559 ts_tablet_manager.cc:1905] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:25.809278 17562 tablet_replica.cc:330] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: stopping tablet replica
I20260806 20:31:25.809566 17562 raft_consensus.cc:2229] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:25.809944 17562 raft_consensus.cc:2258] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:25.810443 17563 ts_tablet_manager.cc:1918] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 20:31:25.810657 17563 log.cc:1196] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/a9c84a42a0054646974f2f4c205be441
I20260806 20:31:25.811578 17563 ts_tablet_manager.cc:1939] T a9c84a42a0054646974f2f4c205be441 P 3dc0adf432c24d92a8b46f64341208f5: Deleting consensus metadata
I20260806 20:31:25.811832 17562 ts_tablet_manager.cc:1905] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:25.812986 16627 catalog_manager.cc:4841] TS 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097): tablet a9c84a42a0054646974f2f4c205be441 (table test-table [id=fa3754b078ad41578bd52779e9c31a5c]) successfully deleted
I20260806 20:31:25.816095 17559 ts_tablet_manager.cc:1918] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 20:31:25.816924 17559 log.cc:1196] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/a9c84a42a0054646974f2f4c205be441
I20260806 20:31:25.817492 17559 ts_tablet_manager.cc:1939] T a9c84a42a0054646974f2f4c205be441 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting consensus metadata
I20260806 20:31:25.818821 16627 catalog_manager.cc:4841] TS 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865): tablet a9c84a42a0054646974f2f4c205be441 (table test-table [id=fa3754b078ad41578bd52779e9c31a5c]) successfully deleted
I20260806 20:31:25.819463 17562 ts_tablet_manager.cc:1918] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 20:31:25.819617 17562 log.cc:1196] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/a9c84a42a0054646974f2f4c205be441
I20260806 20:31:25.820103 17562 ts_tablet_manager.cc:1939] T a9c84a42a0054646974f2f4c205be441 P 922b39b54970410baf2eca5b1b861c27: Deleting consensus metadata
I20260806 20:31:25.821439 16630 catalog_manager.cc:4841] TS 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767): tablet a9c84a42a0054646974f2f4c205be441 (table test-table [id=fa3754b078ad41578bd52779e9c31a5c]) successfully deleted
Aug 06 20:31:25 dist-test-slave-2kcd krb5kdc[16576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048285, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 20:31:25 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048285, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:25.857887 17575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:25.838604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50402 (local address 127.13.149.126:42025)
0806 20:31:25.840913 (+ 2309us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:25.840918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:25.841059 (+ 141us) server_negotiation.cc:407] Connection header received
0806 20:31:25.841310 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:25.841317 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:25.841410 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:25.841544 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:25.843544 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:25.844383 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:25.846610 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:25.847034 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:25.847127 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:25.852190 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:25.852195 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:25.852198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:25.852231 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:25.855152 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:25.855849 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:25.855854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:25.855856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:25.856001 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:25.856393 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:25.856396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:25.856398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:25.856651 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:25.856947 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:25.857261 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 20:31:25.857503 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2114,"thread_start_us":1802,"threads_started":1}
I20260806 20:31:25.862134 16657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:25.863050 16657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:25.871515 16872 tablet_service.cc:1467] Processing CreateTablet for tablet 39aba86c6c7547cd8c443a8906017ab2 (DEFAULT_TABLE table=test-table [id=41e6a8f76f7c400886449c1afd5cb7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:25.872071 16872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39aba86c6c7547cd8c443a8906017ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:25.872056 17087 tablet_service.cc:1467] Processing CreateTablet for tablet 39aba86c6c7547cd8c443a8906017ab2 (DEFAULT_TABLE table=test-table [id=41e6a8f76f7c400886449c1afd5cb7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:25.872179 17289 tablet_service.cc:1467] Processing CreateTablet for tablet 39aba86c6c7547cd8c443a8906017ab2 (DEFAULT_TABLE table=test-table [id=41e6a8f76f7c400886449c1afd5cb7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:25.872596 17087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39aba86c6c7547cd8c443a8906017ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:25.872671 17289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39aba86c6c7547cd8c443a8906017ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:25.888180 17581 tablet_bootstrap.cc:492] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: Bootstrap starting.
I20260806 20:31:25.888440 17579 tablet_bootstrap.cc:492] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: Bootstrap starting.
I20260806 20:31:25.890268 17581 tablet_bootstrap.cc:654] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:25.890291 17579 tablet_bootstrap.cc:654] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:25.891752 17582 tablet_bootstrap.cc:492] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: Bootstrap starting.
I20260806 20:31:25.893018 17579 tablet_bootstrap.cc:492] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: No bootstrap required, opened a new log
I20260806 20:31:25.893265 17579 ts_tablet_manager.cc:1397] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 20:31:25.893352 17582 tablet_bootstrap.cc:654] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:25.894356 17579 raft_consensus.cc:348] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.894781 17579 raft_consensus.cc:374] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:25.894942 17579 raft_consensus.cc:729] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Initialized, Role: FOLLOWER
I20260806 20:31:25.895311 17579 consensus_queue.cc:260] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.899482 17579 ts_tablet_manager.cc:1428] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260806 20:31:25.900705 17546 raft_consensus.cc:482] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:25.900931 17546 raft_consensus.cc:504] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.901480 17582 tablet_bootstrap.cc:492] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: No bootstrap required, opened a new log
I20260806 20:31:25.901660 17582 ts_tablet_manager.cc:1397] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260806 20:31:25.901741 17546 leader_election.cc:288] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767), 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097)
I20260806 20:31:25.902733 17582 raft_consensus.cc:348] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.903069 17582 raft_consensus.cc:374] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:25.903228 17582 raft_consensus.cc:729] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922b39b54970410baf2eca5b1b861c27, State: Initialized, Role: FOLLOWER
I20260806 20:31:25.903607 17582 consensus_queue.cc:260] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.903859 17125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39aba86c6c7547cd8c443a8906017ab2" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27" is_pre_election: true
I20260806 20:31:25.904153 17125 raft_consensus.cc:2454] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 0.
I20260806 20:31:25.905082 16782 leader_election.cc:302] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d9407f6e94b41ea8dbd3395ea8934bc, 922b39b54970410baf2eca5b1b861c27; no voters:
I20260806 20:31:25.905136 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39aba86c6c7547cd8c443a8906017ab2" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5" is_pre_election: true
W20260806 20:31:25.906239 16780 leader_election.cc:341] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097): Illegal state: must be running to vote when last-logged opid is not known
I20260806 20:31:25.906602 17546 raft_consensus.cc:2781] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:25.906751 17546 raft_consensus.cc:482] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:25.906865 17546 raft_consensus.cc:3037] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:25.907732 17581 tablet_bootstrap.cc:492] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: No bootstrap required, opened a new log
I20260806 20:31:25.907991 17581 ts_tablet_manager.cc:1397] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.005s
I20260806 20:31:25.909179 17581 raft_consensus.cc:348] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.909586 17581 raft_consensus.cc:374] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:25.909756 17581 raft_consensus.cc:729] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc0adf432c24d92a8b46f64341208f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:25.910092 17581 consensus_queue.cc:260] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.910265 17582 ts_tablet_manager.cc:1428] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: Time spent starting tablet: real 0.008s user 0.003s sys 0.005s
I20260806 20:31:25.910393 17546 raft_consensus.cc:504] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.911579 17125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39aba86c6c7547cd8c443a8906017ab2" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27"
I20260806 20:31:25.911836 17125 raft_consensus.cc:3037] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:25.915433 17125 raft_consensus.cc:2454] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 1.
I20260806 20:31:25.916483 16782 leader_election.cc:302] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d9407f6e94b41ea8dbd3395ea8934bc, 922b39b54970410baf2eca5b1b861c27; no voters:
I20260806 20:31:25.916805 17533 raft_consensus.cc:2781] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:25.916998 17533 raft_consensus.cc:686] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 LEADER]: Becoming Leader. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Running, Role: LEADER
I20260806 20:31:25.917331 17533 consensus_queue.cc:237] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:25.919059 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39aba86c6c7547cd8c443a8906017ab2" candidate_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc0adf432c24d92a8b46f64341208f5"
I20260806 20:31:25.919266 17317 raft_consensus.cc:3037] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:25.922868 17317 raft_consensus.cc:2454] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9407f6e94b41ea8dbd3395ea8934bc in term 1.
I20260806 20:31:25.917006 17546 leader_election.cc:288] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [CANDIDATE]: Term 1 election: Requested vote from peers 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767), 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097)
I20260806 20:31:25.926275 17581 ts_tablet_manager.cc:1428] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: Time spent starting tablet: real 0.018s user 0.008s sys 0.001s
I20260806 20:31:25.927659 16651 catalog_manager.cc:5495] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65). New cstate: current_term: 1 leader_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } health_report { overall_health: UNKNOWN } } }
I20260806 20:31:25.961004 17594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:25.954758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57508 (local address 127.13.149.65:44865)
0806 20:31:25.955345 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:25.955349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:25.955368 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:31:25.955418 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:25.955421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:25.955489 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:25.955571 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:25.956050 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:25.956916 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:25.959206 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:25.959614 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:25.959706 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:25.960270 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:25.960374 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:25.960451 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:25.960608 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 20:31:25.960667 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":345,"threads_started":1}
I20260806 20:31:25.971316 17317 raft_consensus.cc:1261] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Refusing update from remote peer 5d9407f6e94b41ea8dbd3395ea8934bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:25.971350 17125 raft_consensus.cc:1261] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Refusing update from remote peer 5d9407f6e94b41ea8dbd3395ea8934bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:25.972066 17529 consensus_queue.cc:1035] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:25.972534 17533 consensus_queue.cc:1035] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:26.029371 16657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:26.029685 16657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:26.033612 16657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Sending DeleteTablet for 3 replicas of tablet 39aba86c6c7547cd8c443a8906017ab2
I20260806 20:31:26.034514 17087 tablet_service.cc:1514] Processing DeleteTablet for tablet 39aba86c6c7547cd8c443a8906017ab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:26 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41226
I20260806 20:31:26.034798 17562 tablet_replica.cc:330] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: stopping tablet replica
I20260806 20:31:26.034740 17289 tablet_service.cc:1514] Processing DeleteTablet for tablet 39aba86c6c7547cd8c443a8906017ab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:26 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:40856
I20260806 20:31:26.035027 17562 raft_consensus.cc:2229] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:26.035065 17563 tablet_replica.cc:330] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: stopping tablet replica
I20260806 20:31:26.035251 17562 raft_consensus.cc:2258] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:26.035303 17563 raft_consensus.cc:2229] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:26.035516 17563 raft_consensus.cc:2258] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:26.035602 16657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 20:31:26.036176 16872 tablet_service.cc:1514] Processing DeleteTablet for tablet 39aba86c6c7547cd8c443a8906017ab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:26 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:57488
I20260806 20:31:26.036543 17559 tablet_replica.cc:330] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: stopping tablet replica
W20260806 20:31:26.036551 16657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:26.036815 17562 ts_tablet_manager.cc:1905] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:26.036823 17559 raft_consensus.cc:2229] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:31:26.037199 17559 raft_consensus.cc:2258] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:26.038528 17563 ts_tablet_manager.cc:1905] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:26.041543 17559 ts_tablet_manager.cc:1905] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:26.043853 17087 tablet_service.cc:1467] Processing CreateTablet for tablet f0417781fde049ecb19c62204f1d96e0 (DEFAULT_TABLE table=test-table [id=5172d5e146794a77b163764a0b2d19a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:26.044256 17087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0417781fde049ecb19c62204f1d96e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:26.044731 17562 ts_tablet_manager.cc:1918] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:26.044940 17562 log.cc:1196] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/39aba86c6c7547cd8c443a8906017ab2
I20260806 20:31:26.045451 17562 ts_tablet_manager.cc:1939] T 39aba86c6c7547cd8c443a8906017ab2 P 922b39b54970410baf2eca5b1b861c27: Deleting consensus metadata
I20260806 20:31:26.047580 17289 tablet_service.cc:1467] Processing CreateTablet for tablet f0417781fde049ecb19c62204f1d96e0 (DEFAULT_TABLE table=test-table [id=5172d5e146794a77b163764a0b2d19a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:26.047915 16630 catalog_manager.cc:4841] TS 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767): tablet 39aba86c6c7547cd8c443a8906017ab2 (table test-table [id=41e6a8f76f7c400886449c1afd5cb7ff]) successfully deleted
I20260806 20:31:26.048080 17289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0417781fde049ecb19c62204f1d96e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:26.049201 16872 tablet_service.cc:1467] Processing CreateTablet for tablet f0417781fde049ecb19c62204f1d96e0 (DEFAULT_TABLE table=test-table [id=5172d5e146794a77b163764a0b2d19a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:26.049680 16872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0417781fde049ecb19c62204f1d96e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:26.050412 17582 tablet_bootstrap.cc:492] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: Bootstrap starting.
I20260806 20:31:26.052063 17582 tablet_bootstrap.cc:654] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:26.055766 17581 tablet_bootstrap.cc:492] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: Bootstrap starting.
I20260806 20:31:26.058374 17581 tablet_bootstrap.cc:654] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:26.068601 17581 tablet_bootstrap.cc:492] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: No bootstrap required, opened a new log
I20260806 20:31:26.068895 17581 ts_tablet_manager.cc:1397] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260806 20:31:26.068949 17559 ts_tablet_manager.cc:1918] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:26.069198 17559 log.cc:1196] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/39aba86c6c7547cd8c443a8906017ab2
I20260806 20:31:26.069741 17559 ts_tablet_manager.cc:1939] T 39aba86c6c7547cd8c443a8906017ab2 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting consensus metadata
I20260806 20:31:26.069914 17581 raft_consensus.cc:348] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.070307 17581 raft_consensus.cc:374] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:26.070459 17581 raft_consensus.cc:729] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc0adf432c24d92a8b46f64341208f5, State: Initialized, Role: FOLLOWER
I20260806 20:31:26.070597 17563 ts_tablet_manager.cc:1918] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:31:26.070803 17563 log.cc:1196] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/39aba86c6c7547cd8c443a8906017ab2
I20260806 20:31:26.070851 16627 catalog_manager.cc:4841] TS 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865): tablet 39aba86c6c7547cd8c443a8906017ab2 (table test-table [id=41e6a8f76f7c400886449c1afd5cb7ff]) successfully deleted
I20260806 20:31:26.071066 17579 tablet_bootstrap.cc:492] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: Bootstrap starting.
I20260806 20:31:26.071245 17581 consensus_queue.cc:260] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.071892 17581 ts_tablet_manager.cc:1428] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 20:31:26.072901 17579 tablet_bootstrap.cc:654] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:26.075997 17582 tablet_bootstrap.cc:492] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: No bootstrap required, opened a new log
I20260806 20:31:26.076165 17582 ts_tablet_manager.cc:1397] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.008s
I20260806 20:31:26.076910 17582 raft_consensus.cc:348] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.079063 17582 raft_consensus.cc:374] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:26.079362 17582 raft_consensus.cc:729] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922b39b54970410baf2eca5b1b861c27, State: Initialized, Role: FOLLOWER
I20260806 20:31:26.079836 17582 consensus_queue.cc:260] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.080866 17582 ts_tablet_manager.cc:1428] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260806 20:31:26.081323 17563 ts_tablet_manager.cc:1939] T 39aba86c6c7547cd8c443a8906017ab2 P 3dc0adf432c24d92a8b46f64341208f5: Deleting consensus metadata
I20260806 20:31:26.083640 16627 catalog_manager.cc:4841] TS 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097): tablet 39aba86c6c7547cd8c443a8906017ab2 (table test-table [id=41e6a8f76f7c400886449c1afd5cb7ff]) successfully deleted
I20260806 20:31:26.088963 17579 tablet_bootstrap.cc:492] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: No bootstrap required, opened a new log
I20260806 20:31:26.089190 17579 ts_tablet_manager.cc:1397] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.009s
I20260806 20:31:26.089983 17579 raft_consensus.cc:348] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.090236 17579 raft_consensus.cc:374] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:26.090359 17579 raft_consensus.cc:729] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9407f6e94b41ea8dbd3395ea8934bc, State: Initialized, Role: FOLLOWER
I20260806 20:31:26.090642 17579 consensus_queue.cc:260] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.091292 17579 ts_tablet_manager.cc:1428] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 20:31:26.155791 17591 raft_consensus.cc:482] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:26.156104 17591 raft_consensus.cc:504] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.157771 17591 leader_election.cc:288] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865), 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767)
I20260806 20:31:26.167675 17606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.158150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:40767 (local address 127.13.149.67:57581)
0806 20:31:26.160223 (+ 2073us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:26.160238 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:26.160344 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:26.160667 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:26.160671 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:26.160719 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:26.161260 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.161271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.162703 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.162709 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.165325 (+ 2616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.165340 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.167045 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.167050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.167176 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.167203 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 20:31:26.167286 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 20:31:26.167375 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1949,"mutex_wait_us":151,"spinlock_wait_cycles":768,"thread_start_us":1397,"threads_started":1}
I20260806 20:31:26.167680 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.158298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:57581 (local address 127.13.149.66:40767)
0806 20:31:26.159688 (+ 1390us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:26.159697 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:26.160333 (+ 636us) server_negotiation.cc:407] Connection header received
0806 20:31:26.160452 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:26.160460 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:26.160533 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:26.160631 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:26.161443 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.162586 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.165523 (+ 2937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.166800 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.166997 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.167068 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:26.167324 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 20:31:26.167428 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1188,"thread_start_us":965,"threads_started":1}
I20260806 20:31:26.168680 17594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.158333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:56723 (local address 127.13.149.65:44865)
0806 20:31:26.158576 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:26.158584 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:26.159994 (+ 1410us) server_negotiation.cc:407] Connection header received
0806 20:31:26.160274 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:26.160279 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:26.160382 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:26.160482 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:26.161290 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.162461 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.165523 (+ 3062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.166800 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.166971 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.167050 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:26.168327 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0806 20:31:26.168464 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 20:31:26.168807 17607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.158018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44865 (local address 127.13.149.67:56723)
0806 20:31:26.159869 (+ 1851us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:26.159888 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:26.160101 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:26.160515 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:26.160519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:26.160539 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:26.161074 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.161095 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.162609 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.162612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.165330 (+ 2718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.165340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.167964 (+ 2624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.167969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.168138 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.168174 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 20:31:26.168274 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:31:26.168394 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1708,"mutex_wait_us":230,"spinlock_wait_cycles":1408,"thread_start_us":1879,"threads_started":1}
I20260806 20:31:26.168769 17121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0417781fde049ecb19c62204f1d96e0" candidate_uuid: "3dc0adf432c24d92a8b46f64341208f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27" is_pre_election: true
I20260806 20:31:26.169096 17121 raft_consensus.cc:2454] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc0adf432c24d92a8b46f64341208f5 in term 0.
I20260806 20:31:26.169569 16914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0417781fde049ecb19c62204f1d96e0" candidate_uuid: "3dc0adf432c24d92a8b46f64341208f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" is_pre_election: true
I20260806 20:31:26.169648 17212 leader_election.cc:302] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc0adf432c24d92a8b46f64341208f5, 922b39b54970410baf2eca5b1b861c27; no voters:
I20260806 20:31:26.169835 16914 raft_consensus.cc:2454] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc0adf432c24d92a8b46f64341208f5 in term 0.
I20260806 20:31:26.170137 17591 raft_consensus.cc:2781] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:26.170293 17591 raft_consensus.cc:482] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:26.170433 17591 raft_consensus.cc:3037] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:26.172887 17591 raft_consensus.cc:504] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.173599 17591 leader_election.cc:288] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865), 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767)
I20260806 20:31:26.173930 16914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0417781fde049ecb19c62204f1d96e0" candidate_uuid: "3dc0adf432c24d92a8b46f64341208f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc"
I20260806 20:31:26.174129 16914 raft_consensus.cc:3037] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:26.174157 17121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0417781fde049ecb19c62204f1d96e0" candidate_uuid: "3dc0adf432c24d92a8b46f64341208f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922b39b54970410baf2eca5b1b861c27"
I20260806 20:31:26.174417 17121 raft_consensus.cc:3037] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:26.176254 16914 raft_consensus.cc:2454] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc0adf432c24d92a8b46f64341208f5 in term 1.
I20260806 20:31:26.176568 17121 raft_consensus.cc:2454] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc0adf432c24d92a8b46f64341208f5 in term 1.
I20260806 20:31:26.176708 17209 leader_election.cc:302] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc0adf432c24d92a8b46f64341208f5, 5d9407f6e94b41ea8dbd3395ea8934bc; no voters:
I20260806 20:31:26.177026 17591 raft_consensus.cc:2781] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:26.177419 17591 raft_consensus.cc:686] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 LEADER]: Becoming Leader. State: Replica: 3dc0adf432c24d92a8b46f64341208f5, State: Running, Role: LEADER
I20260806 20:31:26.177790 17591 consensus_queue.cc:237] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } }
I20260806 20:31:26.181344 16657 catalog_manager.cc:5495] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "3dc0adf432c24d92a8b46f64341208f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc0adf432c24d92a8b46f64341208f5" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40097 } health_report { overall_health: HEALTHY } } }
I20260806 20:31:26.230980 17613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.224920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40866 (local address 127.13.149.67:40097)
0806 20:31:26.225521 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:26.225525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:26.225542 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:31:26.225620 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:26.225623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:26.225693 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:26.225875 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:26.226337 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.227157 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.228515 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.229023 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.229161 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.229652 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:26.230292 (+ 640us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:26.230467 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:26.230548 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 20:31:26.230627 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":332,"threads_started":1}
I20260806 20:31:26.246131 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.240409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44865 (local address 127.13.149.67:33579)
0806 20:31:26.241154 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:26.241179 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:26.241316 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:26.241690 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:26.241693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:26.241703 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:26.241984 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.241992 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.243029 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.243032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.244075 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.244087 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.245029 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.245033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.245167 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.245217 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:26.245617 (+ 400us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:26.245625 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 20:31:26.245686 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 20:31:26.245778 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":299,"threads_started":1}
I20260806 20:31:26.246120 17594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.240538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:33579 (local address 127.13.149.65:44865)
0806 20:31:26.240726 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:26.240730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:26.241267 (+ 537us) server_negotiation.cc:407] Connection header received
0806 20:31:26.241460 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:26.241466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:26.241582 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:26.241663 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:26.242140 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.242910 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.244234 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.244733 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.245004 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.245395 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:26.245522 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:26.245608 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:26.245743 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 20:31:26.245816 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 20:31:26.255733 16914 raft_consensus.cc:1261] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Refusing update from remote peer 3dc0adf432c24d92a8b46f64341208f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:26.256214 17121 raft_consensus.cc:1261] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Refusing update from remote peer 3dc0adf432c24d92a8b46f64341208f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:26.256536 17610 consensus_queue.cc:1035] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d9407f6e94b41ea8dbd3395ea8934bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:26.257264 17591 consensus_queue.cc:1035] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922b39b54970410baf2eca5b1b861c27" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:26.284741 17613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.278793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:53067 (local address 127.13.149.67:40097)
0806 20:31:26.278996 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:26.279005 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:26.279526 (+ 521us) server_negotiation.cc:407] Connection header received
0806 20:31:26.279756 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:26.279759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:26.279817 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:26.279888 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:26.280451 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.281357 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.283018 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.283463 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.283600 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.284015 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:26.284116 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:26.284212 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:26.284364 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 20:31:26.284439 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 20:31:26.284869 17622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:26.278706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:40097 (local address 127.13.149.65:53067)
0806 20:31:26.279423 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:26.279448 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:26.279614 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:26.279939 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:26.279943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:26.279954 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:31:26.280301 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.280321 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.281508 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.281513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.282810 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:26.282882 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:26.283647 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:26.283655 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:26.283810 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:26.283853 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:31:26.284222 (+ 369us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:31:26.284236 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 20:31:26.284338 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 20:31:26.284466 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":362,"threads_started":1}
W20260806 20:31:26.285828 17536 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 20:31:27.874461 16657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:27.874769 16657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:27.879410 16657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 675491670fad47b6ac7c8958182de1cd: Sending DeleteTablet for 3 replicas of tablet f0417781fde049ecb19c62204f1d96e0
I20260806 20:31:27.880336 16872 tablet_service.cc:1514] Processing DeleteTablet for tablet f0417781fde049ecb19c62204f1d96e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:27 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:57488
I20260806 20:31:27.880498 17087 tablet_service.cc:1514] Processing DeleteTablet for tablet f0417781fde049ecb19c62204f1d96e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:27 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41226
I20260806 20:31:27.880836 17289 tablet_service.cc:1514] Processing DeleteTablet for tablet f0417781fde049ecb19c62204f1d96e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:27 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:40856
I20260806 20:31:27.881265 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16758
I20260806 20:31:27.883402 17658 tablet_replica.cc:330] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: stopping tablet replica
I20260806 20:31:27.883684 17658 raft_consensus.cc:2229] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:31:27.884213 17658 raft_consensus.cc:2258] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:27.884861 17655 tablet_replica.cc:330] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: stopping tablet replica
I20260806 20:31:27.885136 17655 raft_consensus.cc:2229] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:27.885350 17658 ts_tablet_manager.cc:1905] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:27.885464 17655 raft_consensus.cc:2258] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:27.886059 17656 tablet_replica.cc:330] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: stopping tablet replica
I20260806 20:31:27.886301 17656 raft_consensus.cc:2229] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:27.886606 17656 raft_consensus.cc:2258] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:27.887698 17656 ts_tablet_manager.cc:1905] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:27.887724 17655 ts_tablet_manager.cc:1905] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:27.893324 17658 ts_tablet_manager.cc:1918] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 20:31:27.893540 17658 log.cc:1196] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/f0417781fde049ecb19c62204f1d96e0
I20260806 20:31:27.894117 17658 ts_tablet_manager.cc:1939] T f0417781fde049ecb19c62204f1d96e0 P 3dc0adf432c24d92a8b46f64341208f5: Deleting consensus metadata
I20260806 20:31:27.894896 17656 ts_tablet_manager.cc:1918] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 20:31:27.895138 17656 log.cc:1196] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/f0417781fde049ecb19c62204f1d96e0
I20260806 20:31:27.895197 17655 ts_tablet_manager.cc:1918] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 20:31:27.895459 17655 log.cc:1196] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/f0417781fde049ecb19c62204f1d96e0
I20260806 20:31:27.895577 16627 catalog_manager.cc:4841] TS 3dc0adf432c24d92a8b46f64341208f5 (127.13.149.67:40097): tablet f0417781fde049ecb19c62204f1d96e0 (table test-table [id=5172d5e146794a77b163764a0b2d19a2]) successfully deleted
I20260806 20:31:27.895798 17656 ts_tablet_manager.cc:1939] T f0417781fde049ecb19c62204f1d96e0 P 922b39b54970410baf2eca5b1b861c27: Deleting consensus metadata
I20260806 20:31:27.896106 17655 ts_tablet_manager.cc:1939] T f0417781fde049ecb19c62204f1d96e0 P 5d9407f6e94b41ea8dbd3395ea8934bc: Deleting consensus metadata
I20260806 20:31:27.896900 16630 catalog_manager.cc:4841] TS 922b39b54970410baf2eca5b1b861c27 (127.13.149.66:40767): tablet f0417781fde049ecb19c62204f1d96e0 (table test-table [id=5172d5e146794a77b163764a0b2d19a2]) successfully deleted
I20260806 20:31:27.897383 16627 catalog_manager.cc:4841] TS 5d9407f6e94b41ea8dbd3395ea8934bc (127.13.149.65:44865): tablet f0417781fde049ecb19c62204f1d96e0 (table test-table [id=5172d5e146794a77b163764a0b2d19a2]) successfully deleted
Aug 06 20:31:27 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048285, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:27.904481 17660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:27.883147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57510 (local address 127.13.149.65:44865)
0806 20:31:27.883860 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:27.883866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:27.885489 (+ 1623us) server_negotiation.cc:407] Connection header received
0806 20:31:27.885587 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:27.885597 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:27.885704 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:27.885850 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:27.888074 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:27.889403 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:27.891445 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:27.892259 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:27.892396 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:27.898730 (+ 6334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:27.898748 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:27.898766 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:27.898801 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:27.901864 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:27.902507 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:27.902514 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:27.902517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:27.902656 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:27.903002 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:27.903006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:27.903008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:27.903380 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:27.903626 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:27.903854 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 20:31:27.904042 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":528,"thread_start_us":389,"threads_started":1}
W20260806 20:31:27.905253 16977 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57510
W20260806 20:31:27.905912 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16758: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:27.906131 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16758
I20260806 20:31:27.943596 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16987
Aug 06 20:31:27 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048285, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:27.959137 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:27.944407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41242 (local address 127.13.149.66:40767)
0806 20:31:27.944999 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:27.945003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:27.945020 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:31:27.945075 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:27.945079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:27.945138 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:27.945235 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:27.946501 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:27.947261 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:27.948545 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:27.949044 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:27.949144 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:27.953388 (+ 4244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:27.953406 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:27.953424 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:27.953459 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:27.956272 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:27.956984 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:27.956996 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:27.957002 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:27.957148 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:27.957609 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:27.957614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:27.957616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:27.958038 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:27.958304 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:27.958532 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 20:31:27.958715 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":291,"threads_started":1}
W20260806 20:31:27.959950 17181 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41242
W20260806 20:31:27.960608 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16987: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:27.960767 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16987
I20260806 20:31:27.994741 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17192
Aug 06 20:31:27 dist-test-slave-2kcd krb5kdc[16576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048285, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:28.009919 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:27.995553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40880 (local address 127.13.149.67:40097)
0806 20:31:27.996077 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:27.996081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:27.996097 (+ 16us) server_negotiation.cc:407] Connection header received
0806 20:31:27.996152 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:27.996156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:27.996220 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:27.996312 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:27.997667 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:27.998419 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:27.999586 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:27.999968 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:28.000058 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:28.004397 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:28.004413 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:28.004429 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:28.004464 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:28.007502 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:28.008089 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:28.008096 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:28.008098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:28.008220 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:28.008541 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:28.008544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:28.008546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:28.008963 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:28.009256 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:28.009458 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 20:31:28.009638 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":283,"threads_started":1}
W20260806 20:31:28.010643 17391 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40880
W20260806 20:31:28.011240 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17192: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:28.011430 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17192
I20260806 20:31:28.044199 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16597
I20260806 20:31:28.045481 16711 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:28.163975 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16597
2026-08-06T20:31:28Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8631 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:28 dist-test-slave-2kcd krb5kdc[17673](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:28 dist-test-slave-2kcd krb5kdc[17673](info): set up 2 sockets
Aug 06 20:31:28 dist-test-slave-2kcd krb5kdc[17673](info): commencing operation
krb5kdc: starting...
W20260806 20:31:29.476222 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:29 dist-test-slave-2kcd krb5kdc[17673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:29.702539 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40965
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:40965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:30.030215 17690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:30.030580 17690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:30.030741 17690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:30.038213 17690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:30.038362 17690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:30.038477 17690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:30.038583 17690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:30.038661 17690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:30.048666 17690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:40965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:30.050113 17690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:30.051477 17690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:30.063799 17697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:30.063844 17696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:30.063844 17700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:30.064568 17690 server_base.cc:1034] running on GCE node
I20260806 20:31:30.065442 17690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:30.066931 17690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:30.068135 17690 hybrid_clock.cc:648] HybridClock initialized: now 1786048290068073 us; error 52 us; skew 500 ppm
I20260806 20:31:30.068493 17690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:30 dist-test-slave-2kcd krb5kdc[17673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048290, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:30.076098 17690 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:30.077662 17690 webserver.cc:460] Webserver started at http://127.13.149.126:33549/ using document root <none> and password file <none>
I20260806 20:31:30.078395 17690 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:30.078528 17690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:30.078863 17690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:30.082023 17690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "306d64ebeb9c4287b34b43addc7c7963"
format_stamp: "Formatted at 2026-08-06 20:31:30 on dist-test-slave-2kcd"
server_key: "8ef5de87c8ff9b9225f948380c17f83f"
server_key_iv: "82922c87c371fa12dba8a2f51e276f15"
server_key_version: "encryptionkey@0"
I20260806 20:31:30.082793 17690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "306d64ebeb9c4287b34b43addc7c7963"
format_stamp: "Formatted at 2026-08-06 20:31:30 on dist-test-slave-2kcd"
server_key: "8ef5de87c8ff9b9225f948380c17f83f"
server_key_iv: "82922c87c371fa12dba8a2f51e276f15"
server_key_version: "encryptionkey@0"
I20260806 20:31:30.087951 17690 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 20:31:30.091378 17714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:30.092639 17690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:31:30.092873 17690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "306d64ebeb9c4287b34b43addc7c7963"
format_stamp: "Formatted at 2026-08-06 20:31:30 on dist-test-slave-2kcd"
server_key: "8ef5de87c8ff9b9225f948380c17f83f"
server_key_iv: "82922c87c371fa12dba8a2f51e276f15"
server_key_version: "encryptionkey@0"
I20260806 20:31:30.093089 17690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:30.120137 17690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:30.124250 17690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:30.124562 17690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:30.143360 17690 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:40965
I20260806 20:31:30.143394 17795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:40965 every 8 connection(s)
I20260806 20:31:30.144804 17690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:30.148644 17796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:30.154089 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17690
I20260806 20:31:30.154323 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:30.154961 13909 external_mini_cluster.cc:1428] Setting key a4dff4ade2d5b1b80fd36212263dd215
I20260806 20:31:30.159417 17796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963: Bootstrap starting.
I20260806 20:31:30.163089 17796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:30.164297 17796 log.cc:824] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:30.167483 17796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963: No bootstrap required, opened a new log
Aug 06 20:31:30 dist-test-slave-2kcd krb5kdc[17673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:30.175655 17796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "306d64ebeb9c4287b34b43addc7c7963" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40965 } }
I20260806 20:31:30.176054 17796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:30.176195 17796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 306d64ebeb9c4287b34b43addc7c7963, State: Initialized, Role: FOLLOWER
I20260806 20:31:30.176960 17796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "306d64ebeb9c4287b34b43addc7c7963" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40965 } }
I20260806 20:31:30.177376 17796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:30.177556 17796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:30.177752 17796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:30.178584 17802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:30.157016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60144 (local address 127.13.149.126:40965)
0806 20:31:30.157860 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:30.157872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:30.157911 (+ 39us) server_negotiation.cc:407] Connection header received
0806 20:31:30.159590 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:30.159624 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:30.159993 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:30.160292 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:30.162225 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:30.163575 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:30.165339 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:30.166115 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:30.166262 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:30.171042 (+ 4780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:30.171050 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:30.171064 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:30.171101 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:30.174261 (+ 3160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:30.174988 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:30.174995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:30.175001 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:30.175172 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:30.175561 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:30.175565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:30.175567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:30.176172 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:30.176462 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:30.176971 (+ 509us) server_negotiation.cc:299] Negotiation successful
0806 20:31:30.177381 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":429,"threads_started":1}
I20260806 20:31:30.180269 17796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "306d64ebeb9c4287b34b43addc7c7963" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40965 } }
I20260806 20:31:30.180770 17796 leader_election.cc:302] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 306d64ebeb9c4287b34b43addc7c7963; no voters:
I20260806 20:31:30.181524 17796 leader_election.cc:288] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:30.181643 17807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:30.182397 17807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [term 1 LEADER]: Becoming Leader. State: Replica: 306d64ebeb9c4287b34b43addc7c7963, State: Running, Role: LEADER
I20260806 20:31:30.182988 17807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "306d64ebeb9c4287b34b43addc7c7963" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40965 } }
I20260806 20:31:30.183794 17796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:30.186275 17809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 306d64ebeb9c4287b34b43addc7c7963. Latest consensus state: current_term: 1 leader_uuid: "306d64ebeb9c4287b34b43addc7c7963" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "306d64ebeb9c4287b34b43addc7c7963" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40965 } } }
I20260806 20:31:30.186421 17808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "306d64ebeb9c4287b34b43addc7c7963" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "306d64ebeb9c4287b34b43addc7c7963" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40965 } } }
I20260806 20:31:30.186753 17809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:30.186800 17808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:30.187918 17814 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:30.197854 17814 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:30.207728 17814 catalog_manager.cc:1347] Generated new cluster ID: 3bbf490a44d74862b081f6d386481d5d
I20260806 20:31:30.207849 17814 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:30.234539 17814 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:30.235903 17814 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:30.246171 17814 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 306d64ebeb9c4287b34b43addc7c7963: Generated new TSK 0
I20260806 20:31:30.247083 17814 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:30.310539 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40965
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:30.665589 17840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:30.665921 17840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:30.666102 17840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:30.673365 17840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:30.673516 17840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:30.673683 17840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:30.683878 17840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:30.685429 17840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:30.686731 17840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:30.700031 17847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:30.700181 17849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:30.700367 17852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:30.701121 17840 server_base.cc:1034] running on GCE node
I20260806 20:31:30.701840 17840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:30.702847 17840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:30.704119 17840 hybrid_clock.cc:648] HybridClock initialized: now 1786048290704052 us; error 50 us; skew 500 ppm
I20260806 20:31:30.704465 17840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:30 dist-test-slave-2kcd krb5kdc[17673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048290, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:30.708020 17840 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:30.709559 17840 webserver.cc:460] Webserver started at http://127.13.149.65:41815/ using document root <none> and password file <none>
I20260806 20:31:30.710232 17840 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:30.710345 17840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:30.710623 17840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:30.713791 17840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "5546e93dbd574463b85ff7b8e85c0cd0"
format_stamp: "Formatted at 2026-08-06 20:31:30 on dist-test-slave-2kcd"
server_key: "ec112086cc183928b8a806e4d14fb08b"
server_key_iv: "4ffbeda991330aa6cf47dedd3737f2c2"
server_key_version: "encryptionkey@0"
I20260806 20:31:30.714619 17840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "5546e93dbd574463b85ff7b8e85c0cd0"
format_stamp: "Formatted at 2026-08-06 20:31:30 on dist-test-slave-2kcd"
server_key: "ec112086cc183928b8a806e4d14fb08b"
server_key_iv: "4ffbeda991330aa6cf47dedd3737f2c2"
server_key_version: "encryptionkey@0"
I20260806 20:31:30.720238 17840 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:31:30.723986 17862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:30.725410 17840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 20:31:30.725594 17840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "5546e93dbd574463b85ff7b8e85c0cd0"
format_stamp: "Formatted at 2026-08-06 20:31:30 on dist-test-slave-2kcd"
server_key: "ec112086cc183928b8a806e4d14fb08b"
server_key_iv: "4ffbeda991330aa6cf47dedd3737f2c2"
server_key_version: "encryptionkey@0"
I20260806 20:31:30.725796 17840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:30.745942 17840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:30.750435 17840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:30.750741 17840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:30.751708 17840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:30.753122 17840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:30.753198 17840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:30.753369 17840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:30.753432 17840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:30.787683 17840 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:43209
I20260806 20:31:30.787731 18044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:43209 every 8 connection(s)
I20260806 20:31:30.789188 17840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:30.794776 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17840
I20260806 20:31:30.795025 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:30.795675 13909 external_mini_cluster.cc:1428] Setting key c63b0aace632130292822ccefb659aa1
Aug 06 20:31:30 dist-test-slave-2kcd krb5kdc[17673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048290, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:30.810258 18049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:30.791761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:33255 (local address 127.13.149.126:40965)
0806 20:31:30.792244 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:30.792249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:30.793064 (+ 815us) server_negotiation.cc:407] Connection header received
0806 20:31:30.794890 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:30.794895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:30.794988 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:30.795113 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:30.796864 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:30.797972 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:30.799498 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:30.800249 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:30.800407 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:30.804086 (+ 3679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:30.804095 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:30.804103 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:30.804146 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:30.807001 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:30.807888 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:30.807892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:30.807894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:30.808005 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:30.808462 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:30.808466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:30.808467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:30.808750 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:30.808956 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:30.809846 (+ 890us) server_negotiation.cc:299] Negotiation successful
0806 20:31:30.810008 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":269,"threads_started":1}
I20260806 20:31:30.811775 18051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:30.792142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:40965 (local address 127.13.149.65:33255)
0806 20:31:30.792899 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:30.792947 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:30.794625 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:30.795346 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:30.795353 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:30.795898 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:30.796641 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:30.796661 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:30.798150 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:30.798154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:30.799342 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:30.799354 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:30.800464 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:30.800469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:30.800654 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:30.801476 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:30.801513 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:30.803866 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:30.807138 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:30.807149 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:30.807166 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:30.807770 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:30.808106 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:30.808114 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:30.808120 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:30.808349 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:30.808934 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:30.808944 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:30.809407 (+ 463us) client_negotiation.cc:769] Sending connection context
0806 20:31:30.809735 (+ 328us) client_negotiation.cc:240] Negotiation successful
0806 20:31:30.810279 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":264,"threads_started":1}
I20260806 20:31:30.813400 18045 heartbeater.cc:347] Connected to a master server at 127.13.149.126:40965
I20260806 20:31:30.813706 18045 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:30.814393 18045 heartbeater.cc:511] Master 127.13.149.126:40965 requested a full tablet report, sending...
I20260806 20:31:30.816818 17739 ts_manager.cc:194] Registered new tserver with Master: 5546e93dbd574463b85ff7b8e85c0cd0 (127.13.149.65:43209)
I20260806 20:31:30.818993 17739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:33255
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:30.846537 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40965
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:31.183729 18054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:31.184012 18054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:31.184192 18054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:31.191607 18054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:31.191709 18054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:31.191835 18054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:31.201483 18054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:31.202831 18054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:31.204241 18054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:31.217990 18063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:31.218065 18069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:31.218104 18064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:31.219043 18054 server_base.cc:1034] running on GCE node
I20260806 20:31:31.219672 18054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:31.220675 18054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:31.221902 18054 hybrid_clock.cc:648] HybridClock initialized: now 1786048291221825 us; error 52 us; skew 500 ppm
I20260806 20:31:31.222214 18054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:31 dist-test-slave-2kcd krb5kdc[17673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048291, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:31.225502 18054 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:31.226969 18054 webserver.cc:460] Webserver started at http://127.13.149.66:36579/ using document root <none> and password file <none>
I20260806 20:31:31.227608 18054 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:31.227708 18054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:31.227974 18054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:31.230929 18054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "076ed27b04524417ac4a512d1b4a3403"
format_stamp: "Formatted at 2026-08-06 20:31:31 on dist-test-slave-2kcd"
server_key: "c035fd6ba76dc55c9bd1236d566e867a"
server_key_iv: "3f9cfa036020f74864eef142db8bf5e7"
server_key_version: "encryptionkey@0"
I20260806 20:31:31.231662 18054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "076ed27b04524417ac4a512d1b4a3403"
format_stamp: "Formatted at 2026-08-06 20:31:31 on dist-test-slave-2kcd"
server_key: "c035fd6ba76dc55c9bd1236d566e867a"
server_key_iv: "3f9cfa036020f74864eef142db8bf5e7"
server_key_version: "encryptionkey@0"
I20260806 20:31:31.236690 18054 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260806 20:31:31.240113 18083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:31.241451 18054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:31.241621 18054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "076ed27b04524417ac4a512d1b4a3403"
format_stamp: "Formatted at 2026-08-06 20:31:31 on dist-test-slave-2kcd"
server_key: "c035fd6ba76dc55c9bd1236d566e867a"
server_key_iv: "3f9cfa036020f74864eef142db8bf5e7"
server_key_version: "encryptionkey@0"
I20260806 20:31:31.241825 18054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:31.253687 18054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:31.257578 18054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:31.257870 18054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:31.258809 18054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:31.260157 18054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:31.260231 18054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:31.260387 18054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:31.260440 18054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:31.294324 18054 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:42457
I20260806 20:31:31.294368 18265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:42457 every 8 connection(s)
I20260806 20:31:31.295644 18054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:31.297739 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 18054
I20260806 20:31:31.297966 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:31.298434 13909 external_mini_cluster.cc:1428] Setting key ea1fd7418d47ef76b1fb09477c44ac50
Aug 06 20:31:31 dist-test-slave-2kcd krb5kdc[17673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048291, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
I20260806 20:31:31.323102 18049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:31.298656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:49021 (local address 127.13.149.126:40965)
0806 20:31:31.298873 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:31.298880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:31.300120 (+ 1240us) server_negotiation.cc:407] Connection header received
0806 20:31:31.307107 (+ 6987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:31.307111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:31.307183 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:31.307271 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:31.309326 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.310265 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.311860 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.312673 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.312838 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:31.316565 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:31.316574 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:31.316582 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:31.316632 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:31.319742 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:31.320585 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:31.320590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:31.320592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:31.320723 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:31.321207 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:31.321216 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:31.321218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:31.321542 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:31.321718 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:31.322461 (+ 743us) server_negotiation.cc:299] Negotiation successful
0806 20:31:31.322737 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
I20260806 20:31:31.324400 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:31.299146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:40965 (local address 127.13.149.66:49021)
0806 20:31:31.299959 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:31.299999 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:31.306771 (+ 6772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:31.307572 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:31.307587 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:31.308398 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:31.309147 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:31.309166 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.310451 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.310455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:31.311705 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:31.311717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.312975 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.312981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:31.313188 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:31.313994 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:31.314025 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:31.316304 (+ 2279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:31.319904 (+ 3600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:31.319914 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:31.319933 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:31.320434 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:31.320860 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:31.320865 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:31.320869 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:31.321071 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:31.321679 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:31.321687 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:31.322072 (+ 385us) client_negotiation.cc:769] Sending connection context
0806 20:31:31.322345 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 20:31:31.323143 (+ 798us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":342,"threads_started":1}
I20260806 20:31:31.326066 18266 heartbeater.cc:347] Connected to a master server at 127.13.149.126:40965
I20260806 20:31:31.326460 18266 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:31.327385 18266 heartbeater.cc:511] Master 127.13.149.126:40965 requested a full tablet report, sending...
I20260806 20:31:31.329192 17739 ts_manager.cc:194] Registered new tserver with Master: 076ed27b04524417ac4a512d1b4a3403 (127.13.149.66:42457)
I20260806 20:31:31.330188 17739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:49021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:31.352525 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40965
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:31.689760 18272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:31.690043 18272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:31.690209 18272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:31.697743 18272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:31.697901 18272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:31.698073 18272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:31.708156 18272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:31.709645 18272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:31.711022 18272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:31.724727 18281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:31.724684 18284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:31.725261 18278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:31.725945 18272 server_base.cc:1034] running on GCE node
I20260806 20:31:31.726503 18272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:31.727409 18272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:31.728624 18272 hybrid_clock.cc:648] HybridClock initialized: now 1786048291728583 us; error 31 us; skew 500 ppm
I20260806 20:31:31.728988 18272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:31 dist-test-slave-2kcd krb5kdc[17673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048291, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:31.732386 18272 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:31.733981 18272 webserver.cc:460] Webserver started at http://127.13.149.67:44181/ using document root <none> and password file <none>
I20260806 20:31:31.734694 18272 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:31.734828 18272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:31.735160 18272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:31.738219 18272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "ff34f3f788ef412a9060cfd2394a5e18"
format_stamp: "Formatted at 2026-08-06 20:31:31 on dist-test-slave-2kcd"
server_key: "cc8564a5a98246d25cc5d346ee0d17cf"
server_key_iv: "65e27d623a9e7e3065f6804cc09533cb"
server_key_version: "encryptionkey@0"
I20260806 20:31:31.739043 18272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "ff34f3f788ef412a9060cfd2394a5e18"
format_stamp: "Formatted at 2026-08-06 20:31:31 on dist-test-slave-2kcd"
server_key: "cc8564a5a98246d25cc5d346ee0d17cf"
server_key_iv: "65e27d623a9e7e3065f6804cc09533cb"
server_key_version: "encryptionkey@0"
I20260806 20:31:31.744201 18272 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 20:31:31.747716 18292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:31.749110 18272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:31.749274 18272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "ff34f3f788ef412a9060cfd2394a5e18"
format_stamp: "Formatted at 2026-08-06 20:31:31 on dist-test-slave-2kcd"
server_key: "cc8564a5a98246d25cc5d346ee0d17cf"
server_key_iv: "65e27d623a9e7e3065f6804cc09533cb"
server_key_version: "encryptionkey@0"
I20260806 20:31:31.749485 18272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:31.765451 18272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:31.769368 18272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:31.769677 18272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:31.770622 18272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:31.771939 18272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:31.772042 18272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:31.772208 18272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:31.772260 18272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:31.807783 18272 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:35963
I20260806 20:31:31.807827 18482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:35963 every 8 connection(s)
I20260806 20:31:31.809192 18272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:31.810202 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 18272
I20260806 20:31:31.810439 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:31.811002 13909 external_mini_cluster.cc:1428] Setting key e6af4e8f83a86cf876eff96cc4273de5
I20260806 20:31:31.822038 18045 heartbeater.cc:503] Master 127.13.149.126:40965 was elected leader, sending a full tablet report...
Aug 06 20:31:31 dist-test-slave-2kcd krb5kdc[17673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048291, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:31.830130 18049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:31.812184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:59733 (local address 127.13.149.126:40965)
0806 20:31:31.812394 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:31.812399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:31.813849 (+ 1450us) server_negotiation.cc:407] Connection header received
0806 20:31:31.815700 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:31.815704 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:31.815772 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:31.815852 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:31.817335 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.818181 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.819640 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.820031 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.820123 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:31.823759 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:31.823764 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:31.823767 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:31.823796 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:31.827064 (+ 3268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:31.827773 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:31.827778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:31.827784 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:31.827914 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:31.828363 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:31.828367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:31.828369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:31.828638 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:31.828836 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:31.829571 (+ 735us) server_negotiation.cc:299] Negotiation successful
0806 20:31:31.829788 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:31:31.831053 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:31.812761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:40965 (local address 127.13.149.67:59733)
0806 20:31:31.813681 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:31.813735 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:31.815454 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:31.816039 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:31.816046 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:31.816539 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:31.817188 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:31.817207 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.818313 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.818316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:31.819512 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:31.819524 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:31.820215 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:31.820220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:31.820410 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:31.821091 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:31.821112 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:31.823541 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:31.827200 (+ 3659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:31.827209 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:31.827223 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:31.827642 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:31.828037 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:31.828042 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:31.828046 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:31.828233 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:31.828801 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:31.828810 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:31.829189 (+ 379us) client_negotiation.cc:769] Sending connection context
0806 20:31:31.829456 (+ 267us) client_negotiation.cc:240] Negotiation successful
0806 20:31:31.829976 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":380,"threads_started":1}
I20260806 20:31:31.832332 18483 heartbeater.cc:347] Connected to a master server at 127.13.149.126:40965
I20260806 20:31:31.832595 18483 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:31.833315 18483 heartbeater.cc:511] Master 127.13.149.126:40965 requested a full tablet report, sending...
I20260806 20:31:31.834631 17739 ts_manager.cc:194] Registered new tserver with Master: ff34f3f788ef412a9060cfd2394a5e18 (127.13.149.67:35963)
I20260806 20:31:31.835413 17739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:59733
I20260806 20:31:31.838774 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 20:31:31.874608 18049 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:31.871973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52206 (local address 127.13.149.126:40965)
0806 20:31:31.872148 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:31.872152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:31.872684 (+ 532us) server_negotiation.cc:407] Connection header received
0806 20:31:31.872916 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:31.872920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:31.872988 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:31.873073 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:31.874323 (+ 1250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52206: BlockingRecv error: recv got EOF from 127.0.0.1:52206 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 20:31:31.878089 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17840
W20260806 20:31:31.880993 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17840: Not authorized: Client connection negotiation failed: client connection to 127.13.149.65:43209: server requires authentication, but client does not have Kerberos credentials available
I20260806 20:31:31.881178 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17840
I20260806 20:31:31.909801 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18054
W20260806 20:31:31.912503 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18054: Not authorized: Client connection negotiation failed: client connection to 127.13.149.66:42457: server requires authentication, but client does not have Kerberos credentials available
I20260806 20:31:31.912688 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 18054
I20260806 20:31:31.936483 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18272
W20260806 20:31:31.939847 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18272: Not authorized: Client connection negotiation failed: client connection to 127.13.149.67:35963: server requires authentication, but client does not have Kerberos credentials available
I20260806 20:31:31.940029 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 18272
I20260806 20:31:31.962481 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17690
I20260806 20:31:31.963740 17789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:32.068917 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17690
2026-08-06T20:31:32Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3906 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:32 dist-test-slave-2kcd krb5kdc[18505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:32 dist-test-slave-2kcd krb5kdc[18505](info): set up 2 sockets
Aug 06 20:31:32 dist-test-slave-2kcd krb5kdc[18505](info): commencing operation
krb5kdc: starting...
W20260806 20:31:33.390692 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.003s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:33 dist-test-slave-2kcd krb5kdc[18505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:33.609647 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:45203
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:45203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:33.936293 18524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:33.936656 18524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:33.936872 18524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:33.944154 18524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:33.944319 18524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:33.944437 18524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:33.944550 18524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:33.944643 18524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:33.954923 18524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:45203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:45203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:33.956408 18524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:33.957842 18524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:33.970345 18537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:33.970431 18533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:33.970474 18534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:33.971365 18524 server_base.cc:1034] running on GCE node
I20260806 20:31:33.972100 18524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:33.973460 18524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:33.974690 18524 hybrid_clock.cc:648] HybridClock initialized: now 1786048293974656 us; error 46 us; skew 500 ppm
I20260806 20:31:33.975040 18524 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:33 dist-test-slave-2kcd krb5kdc[18505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048293, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:33.978147 18524 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:33.979564 18524 webserver.cc:460] Webserver started at http://127.13.149.126:33749/ using document root <none> and password file <none>
I20260806 20:31:33.980186 18524 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:33.980285 18524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:33.980541 18524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:33.983453 18524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "91731d201ac14b258770e88082539022"
format_stamp: "Formatted at 2026-08-06 20:31:33 on dist-test-slave-2kcd"
server_key: "2e0587fd0c4bac0df41631f7468bb90c"
server_key_iv: "8e8284096f321dbd22ff9857aa047365"
server_key_version: "encryptionkey@0"
I20260806 20:31:33.984184 18524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "91731d201ac14b258770e88082539022"
format_stamp: "Formatted at 2026-08-06 20:31:33 on dist-test-slave-2kcd"
server_key: "2e0587fd0c4bac0df41631f7468bb90c"
server_key_iv: "8e8284096f321dbd22ff9857aa047365"
server_key_version: "encryptionkey@0"
I20260806 20:31:33.989213 18524 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 20:31:33.992372 18545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:33.993649 18524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:33.993824 18524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "91731d201ac14b258770e88082539022"
format_stamp: "Formatted at 2026-08-06 20:31:33 on dist-test-slave-2kcd"
server_key: "2e0587fd0c4bac0df41631f7468bb90c"
server_key_iv: "8e8284096f321dbd22ff9857aa047365"
server_key_version: "encryptionkey@0"
I20260806 20:31:33.994045 18524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:34.013583 18524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:34.017411 18524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:34.017688 18524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:34.036262 18524 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:45203
I20260806 20:31:34.036301 18630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:45203 every 8 connection(s)
I20260806 20:31:34.037631 18524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:34.041328 18631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:34.047125 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 18524
I20260806 20:31:34.047369 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:34.048045 13909 external_mini_cluster.cc:1428] Setting key 042fadd726618627de3c1bdd6ca19326
I20260806 20:31:34.051955 18631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022: Bootstrap starting.
I20260806 20:31:34.055992 18631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:34.057189 18631 log.cc:824] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:34.060249 18631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022: No bootstrap required, opened a new log
Aug 06 20:31:34 dist-test-slave-2kcd krb5kdc[18505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:34.068984 18631 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91731d201ac14b258770e88082539022" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45203 } }
I20260806 20:31:34.069358 18631 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:34.069491 18631 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91731d201ac14b258770e88082539022, State: Initialized, Role: FOLLOWER
I20260806 20:31:34.070236 18631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91731d201ac14b258770e88082539022" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45203 } }
I20260806 20:31:34.070520 18631 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:34.070685 18631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:34.070895 18631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:34.071713 18636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:34.049900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36446 (local address 127.13.149.126:45203)
0806 20:31:34.050737 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:34.050748 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:34.050786 (+ 38us) server_negotiation.cc:407] Connection header received
0806 20:31:34.052511 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:34.052531 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:34.052933 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:34.053263 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:34.055486 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:34.056921 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:34.058578 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:34.059212 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:34.059345 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:34.064137 (+ 4792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:34.064144 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:34.064158 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:34.064197 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:34.067368 (+ 3171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:34.068124 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:34.068140 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:34.068149 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:34.068314 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:34.068720 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:34.068725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:34.068728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:34.069381 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:34.069727 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:34.070164 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 20:31:34.070561 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":387,"threads_started":1}
I20260806 20:31:34.073520 18631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91731d201ac14b258770e88082539022" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45203 } }
I20260806 20:31:34.074062 18631 leader_election.cc:302] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91731d201ac14b258770e88082539022; no voters:
I20260806 20:31:34.074761 18631 leader_election.cc:288] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:34.074874 18642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:34.075649 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:31:34.076098 18642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [term 1 LEADER]: Becoming Leader. State: Replica: 91731d201ac14b258770e88082539022, State: Running, Role: LEADER
I20260806 20:31:34.076664 18642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91731d201ac14b258770e88082539022" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45203 } }
I20260806 20:31:34.077155 18631 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:34.079713 18643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91731d201ac14b258770e88082539022" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91731d201ac14b258770e88082539022" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45203 } } }
I20260806 20:31:34.080142 18643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:34.083932 18644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91731d201ac14b258770e88082539022. Latest consensus state: current_term: 1 leader_uuid: "91731d201ac14b258770e88082539022" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91731d201ac14b258770e88082539022" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 45203 } } }
I20260806 20:31:34.084242 18644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:34.085958 18647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:34.090920 18647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:34.113044 18647 catalog_manager.cc:1347] Generated new cluster ID: 03184d56406a42bcaefac0541d20341e
I20260806 20:31:34.114372 18647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:34.149802 18636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:34.140190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36448 (local address 127.13.149.126:45203)
0806 20:31:34.140394 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:34.140401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:34.141059 (+ 658us) server_negotiation.cc:407] Connection header received
0806 20:31:34.141264 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:34.141270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:34.141353 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:34.141465 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:34.142816 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:34.143916 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:34.145843 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:34.146493 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:34.146629 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:34.147937 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:34.147944 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:34.147949 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:34.148910 (+ 961us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:34.148976 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:34.149006 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:34.149135 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:34.149285 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 20:31:34.149384 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:31:34.151288 18647 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:34.152632 18647 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:34.160913 18647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91731d201ac14b258770e88082539022: Generated new TSK 0
I20260806 20:31:34.161717 18647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:31:34.171449 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18524
I20260806 20:31:34.172659 18622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:34.269511 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 18524
2026-08-06T20:31:34Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2191 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:34 dist-test-slave-2kcd krb5kdc[18692](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:34 dist-test-slave-2kcd krb5kdc[18692](info): set up 2 sockets
Aug 06 20:31:34 dist-test-slave-2kcd krb5kdc[18692](info): commencing operation
krb5kdc: starting...
W20260806 20:31:35.570407 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:35 dist-test-slave-2kcd krb5kdc[18692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:35.776297 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:39167
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:33437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:39167
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:36.109608 18706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:36.109968 18706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:36.110143 18706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:36.117470 18706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:36.117611 18706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:36.117719 18706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:36.117828 18706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:36.117910 18706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:36.127413 18706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:39167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:39167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:36.128760 18706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:36.130106 18706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:36.141788 18713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:36.141752 18715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:36.141822 18719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:36.142845 18706 server_base.cc:1034] running on GCE node
I20260806 20:31:36.143690 18706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:36.145114 18706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:36.146369 18706 hybrid_clock.cc:648] HybridClock initialized: now 1786048296146308 us; error 44 us; skew 500 ppm
I20260806 20:31:36.146709 18706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:36 dist-test-slave-2kcd krb5kdc[18692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048296, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:36.154080 18706 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:36.155517 18706 webserver.cc:460] Webserver started at http://127.13.149.126:39177/ using document root <none> and password file <none>
I20260806 20:31:36.156203 18706 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:36.156355 18706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:36.156725 18706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:36.159684 18706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "790a3770f75d4aa9b5061f05261b35a2"
format_stamp: "Formatted at 2026-08-06 20:31:36 on dist-test-slave-2kcd"
server_key: "4fa10cb678b9cbb37d7019afffb9c839"
server_key_iv: "544a7043e0d9b3f0673ca26c7636f6dc"
server_key_version: "encryptionkey@0"
I20260806 20:31:36.160454 18706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "790a3770f75d4aa9b5061f05261b35a2"
format_stamp: "Formatted at 2026-08-06 20:31:36 on dist-test-slave-2kcd"
server_key: "4fa10cb678b9cbb37d7019afffb9c839"
server_key_iv: "544a7043e0d9b3f0673ca26c7636f6dc"
server_key_version: "encryptionkey@0"
I20260806 20:31:36.165582 18706 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:31:36.169018 18732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:36.170284 18706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:31:36.170475 18706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "790a3770f75d4aa9b5061f05261b35a2"
format_stamp: "Formatted at 2026-08-06 20:31:36 on dist-test-slave-2kcd"
server_key: "4fa10cb678b9cbb37d7019afffb9c839"
server_key_iv: "544a7043e0d9b3f0673ca26c7636f6dc"
server_key_version: "encryptionkey@0"
I20260806 20:31:36.170667 18706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:36.197280 18706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:36.201344 18706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:36.201642 18706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:36.220353 18706 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:39167
I20260806 20:31:36.220395 18824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:39167 every 8 connection(s)
I20260806 20:31:36.221705 18706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:36.225330 18827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:36.228149 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 18706
I20260806 20:31:36.228394 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:36.229269 13909 external_mini_cluster.cc:1428] Setting key 658b269c5293e199575a3385d593e213
I20260806 20:31:36.238205 18827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2: Bootstrap starting.
I20260806 20:31:36.242059 18827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:36.243516 18827 log.cc:824] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2: Log is configured to *not* fsync() on all Append() calls
Aug 06 20:31:36 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:36.246572 18827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2: No bootstrap required, opened a new log
I20260806 20:31:36.253847 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:36.231387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58240 (local address 127.13.149.126:39167)
0806 20:31:36.232174 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:36.232186 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:36.232225 (+ 39us) server_negotiation.cc:407] Connection header received
0806 20:31:36.233920 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:36.233942 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:36.234316 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:36.234633 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:36.236419 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:36.237763 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:36.239467 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:36.240121 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:36.240249 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:36.245383 (+ 5134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:36.245391 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:36.245404 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:36.245440 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:36.248550 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:36.249390 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:36.249396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:36.249402 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:36.249689 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:36.250126 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:36.250132 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:36.250139 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:36.250954 (+ 815us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:36.251329 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:36.251752 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 20:31:36.252286 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":373,"threads_started":1}
I20260806 20:31:36.257864 18827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790a3770f75d4aa9b5061f05261b35a2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39167 } }
I20260806 20:31:36.258306 18827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:36.258446 18827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 790a3770f75d4aa9b5061f05261b35a2, State: Initialized, Role: FOLLOWER
I20260806 20:31:36.259122 18827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790a3770f75d4aa9b5061f05261b35a2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39167 } }
I20260806 20:31:36.259441 18827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:36.259617 18827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:36.259847 18827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:36.262172 18827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790a3770f75d4aa9b5061f05261b35a2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39167 } }
I20260806 20:31:36.262728 18827 leader_election.cc:302] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 790a3770f75d4aa9b5061f05261b35a2; no voters:
I20260806 20:31:36.263356 18827 leader_election.cc:288] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:36.263514 18833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:36.264262 18833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [term 1 LEADER]: Becoming Leader. State: Replica: 790a3770f75d4aa9b5061f05261b35a2, State: Running, Role: LEADER
I20260806 20:31:36.264859 18833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790a3770f75d4aa9b5061f05261b35a2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39167 } }
I20260806 20:31:36.265642 18827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:36.267621 18834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "790a3770f75d4aa9b5061f05261b35a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790a3770f75d4aa9b5061f05261b35a2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39167 } } }
I20260806 20:31:36.268018 18834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:36.267585 18835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 790a3770f75d4aa9b5061f05261b35a2. Latest consensus state: current_term: 1 leader_uuid: "790a3770f75d4aa9b5061f05261b35a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790a3770f75d4aa9b5061f05261b35a2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39167 } } }
I20260806 20:31:36.268565 18835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:36.269071 18841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:36.274845 18841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:36.275758 18854 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 20:31:36.283571 18841 catalog_manager.cc:1347] Generated new cluster ID: 1da113b3da45489f848f928e9cf9bc0e
I20260806 20:31:36.283685 18841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:36.304893 18841 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:36.306216 18841 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:36.315711 18841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 790a3770f75d4aa9b5061f05261b35a2: Generated new TSK 0
I20260806 20:31:36.316768 18841 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:36.374437 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39167
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:33437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:36.725600 18861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:36.725891 18861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:36.726095 18861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:36.733482 18861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:36.733631 18861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:36.733855 18861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:36.743662 18861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:36.745051 18861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:36.746414 18861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:36.760119 18875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:36.760202 18872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:36.760157 18877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:36.760974 18861 server_base.cc:1034] running on GCE node
I20260806 20:31:36.761580 18861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:36.762507 18861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:36.763732 18861 hybrid_clock.cc:648] HybridClock initialized: now 1786048296763683 us; error 60 us; skew 500 ppm
I20260806 20:31:36.764038 18861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:36 dist-test-slave-2kcd krb5kdc[18692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048296, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:36.767381 18861 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:36.768934 18861 webserver.cc:460] Webserver started at http://127.13.149.65:43389/ using document root <none> and password file <none>
I20260806 20:31:36.769611 18861 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:36.769714 18861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:36.769968 18861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:36.773087 18861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "f998020f203d49a7969f66f86389dce3"
format_stamp: "Formatted at 2026-08-06 20:31:36 on dist-test-slave-2kcd"
server_key: "2c25804cd634aec70a8ff91018cd738f"
server_key_iv: "5593092995aa9c1c192ab88c9a4d02c0"
server_key_version: "encryptionkey@0"
I20260806 20:31:36.773904 18861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "f998020f203d49a7969f66f86389dce3"
format_stamp: "Formatted at 2026-08-06 20:31:36 on dist-test-slave-2kcd"
server_key: "2c25804cd634aec70a8ff91018cd738f"
server_key_iv: "5593092995aa9c1c192ab88c9a4d02c0"
server_key_version: "encryptionkey@0"
I20260806 20:31:36.778891 18861 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:31:36.782150 18887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:36.783411 18861 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 20:31:36.783605 18861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "f998020f203d49a7969f66f86389dce3"
format_stamp: "Formatted at 2026-08-06 20:31:36 on dist-test-slave-2kcd"
server_key: "2c25804cd634aec70a8ff91018cd738f"
server_key_iv: "5593092995aa9c1c192ab88c9a4d02c0"
server_key_version: "encryptionkey@0"
I20260806 20:31:36.783807 18861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:36.804103 18861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:36.808257 18861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:36.808602 18861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:36.809633 18861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:36.811017 18861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:36.811093 18861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:36.811270 18861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:36.811333 18861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:36.846064 18861 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:46461
I20260806 20:31:36.846112 19070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:46461 every 8 connection(s)
I20260806 20:31:36.847414 18861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:36.848973 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 18861
I20260806 20:31:36.849195 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:36.849969 13909 external_mini_cluster.cc:1428] Setting key 060faa66fc1e84ed20a5d33a32e759a5
Aug 06 20:31:36 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048296, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:36.872673 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:36.850385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:35461 (local address 127.13.149.126:39167)
0806 20:31:36.850889 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:36.850895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:36.852069 (+ 1174us) server_negotiation.cc:407] Connection header received
0806 20:31:36.854877 (+ 2808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:36.854881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:36.854944 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:36.855046 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:36.857206 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:36.857894 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:36.860394 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:36.860861 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:36.861042 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:36.865164 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:36.865173 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:36.865180 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:36.865226 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:36.868936 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:36.869696 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:36.869704 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:36.869710 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:36.869861 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:36.870336 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:36.870344 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:36.870350 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:36.870813 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:36.870969 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:36.871902 (+ 933us) server_negotiation.cc:299] Negotiation successful
0806 20:31:36.872158 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":243,"threads_started":1}
I20260806 20:31:36.873488 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:36.850985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39167 (local address 127.13.149.65:35461)
0806 20:31:36.851802 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:36.851883 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:36.854585 (+ 2702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:36.855340 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:36.855353 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:36.856164 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:36.857030 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:36.857059 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:36.858077 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:36.858085 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:36.860234 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:36.860252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:36.861140 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:36.861147 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:36.861390 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:36.862132 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:36.862160 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:36.864930 (+ 2770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:36.869086 (+ 4156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:36.869094 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:36.869107 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:36.869550 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:36.869999 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:36.870003 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:36.870005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:36.870197 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:36.870980 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:36.870986 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:36.871365 (+ 379us) client_negotiation.cc:769] Sending connection context
0806 20:31:36.871720 (+ 355us) client_negotiation.cc:240] Negotiation successful
0806 20:31:36.872168 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":352,"threads_started":1}
I20260806 20:31:36.875211 19071 heartbeater.cc:347] Connected to a master server at 127.13.149.126:39167
I20260806 20:31:36.875519 19071 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
I20260806 20:31:36.876284 19071 heartbeater.cc:511] Master 127.13.149.126:39167 requested a full tablet report, sending...
I20260806 20:31:36.878544 18761 ts_manager.cc:194] Registered new tserver with Master: f998020f203d49a7969f66f86389dce3 (127.13.149.65:46461)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
I20260806 20:31:36.880116 18761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:35461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:36.904237 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39167
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:33437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:37.236110 19084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:37.236387 19084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:37.236483 19084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:37.244460 19084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:37.244577 19084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:37.244693 19084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:37.254669 19084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:37.255967 19084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:37.257314 19084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:37.270818 19091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:37.270897 19092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:37.270782 19094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:37.271687 19084 server_base.cc:1034] running on GCE node
I20260806 20:31:37.272322 19084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:37.273310 19084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:37.274570 19084 hybrid_clock.cc:648] HybridClock initialized: now 1786048297274502 us; error 51 us; skew 500 ppm
I20260806 20:31:37.274902 19084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:37 dist-test-slave-2kcd krb5kdc[18692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:37.278254 19084 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:37.279716 19084 webserver.cc:460] Webserver started at http://127.13.149.66:35229/ using document root <none> and password file <none>
I20260806 20:31:37.280419 19084 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:37.280565 19084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:37.280947 19084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:37.283881 19084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "533e66d342e64e0d99bcd2e87a9baad7"
format_stamp: "Formatted at 2026-08-06 20:31:37 on dist-test-slave-2kcd"
server_key: "335c5e25ae4388a8e0e47ee8926ae43e"
server_key_iv: "21ed28a00df590513b1261142ba919f4"
server_key_version: "encryptionkey@0"
I20260806 20:31:37.284672 19084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "533e66d342e64e0d99bcd2e87a9baad7"
format_stamp: "Formatted at 2026-08-06 20:31:37 on dist-test-slave-2kcd"
server_key: "335c5e25ae4388a8e0e47ee8926ae43e"
server_key_iv: "21ed28a00df590513b1261142ba919f4"
server_key_version: "encryptionkey@0"
I20260806 20:31:37.289986 19084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 20:31:37.293453 19103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:37.294711 19084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:31:37.294894 19084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "533e66d342e64e0d99bcd2e87a9baad7"
format_stamp: "Formatted at 2026-08-06 20:31:37 on dist-test-slave-2kcd"
server_key: "335c5e25ae4388a8e0e47ee8926ae43e"
server_key_iv: "21ed28a00df590513b1261142ba919f4"
server_key_version: "encryptionkey@0"
I20260806 20:31:37.295086 19084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:37.308574 19084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:37.313154 19084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:37.313475 19084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:37.314494 19084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:37.315860 19084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:37.315958 19084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:37.316087 19084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:37.316164 19084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:37.350761 19084 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:46829
I20260806 20:31:37.350850 19268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:46829 every 8 connection(s)
I20260806 20:31:37.352100 19084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:37.355085 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 19084
I20260806 20:31:37.355278 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:37.355734 13909 external_mini_cluster.cc:1428] Setting key 1976740f8469a282cace54c2b840ce14
Aug 06 20:31:37 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:37.374455 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:37.354813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:44551 (local address 127.13.149.126:39167)
0806 20:31:37.355031 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:37.355038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:37.356422 (+ 1384us) server_negotiation.cc:407] Connection header received
0806 20:31:37.358530 (+ 2108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:37.358535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:37.358622 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:37.358742 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:37.360234 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.361035 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.362571 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.362999 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.363136 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:37.367155 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:37.367164 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:37.367190 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:37.367236 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:37.371015 (+ 3779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.371754 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.371762 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.371768 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.371952 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.372421 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.372429 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.372435 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.372879 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:37.373030 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:37.373738 (+ 708us) server_negotiation.cc:299] Negotiation successful
0806 20:31:37.374007 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 20:31:37.375936 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:37.355329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39167 (local address 127.13.149.66:44551)
0806 20:31:37.356242 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:37.356288 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:37.358262 (+ 1974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:37.358995 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:37.359004 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:37.359503 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:37.360064 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:37.360081 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.361180 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.361186 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:37.362421 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:37.362433 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.363236 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.363243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:37.363472 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:37.364178 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:37.364199 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:37.366923 (+ 2724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:37.371159 (+ 4236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:37.371166 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:37.371180 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:37.371642 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:37.372103 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:37.372106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:37.372108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:37.372293 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:37.373011 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:37.373017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:37.373343 (+ 326us) client_negotiation.cc:769] Sending connection context
0806 20:31:37.373586 (+ 243us) client_negotiation.cc:240] Negotiation successful
0806 20:31:37.374235 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":359,"threads_started":1}
I20260806 20:31:37.377642 19269 heartbeater.cc:347] Connected to a master server at 127.13.149.126:39167
I20260806 20:31:37.378021 19269 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:37.379060 19269 heartbeater.cc:511] Master 127.13.149.126:39167 requested a full tablet report, sending...
I20260806 20:31:37.380846 18761 ts_manager.cc:194] Registered new tserver with Master: 533e66d342e64e0d99bcd2e87a9baad7 (127.13.149.66:46829)
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
I20260806 20:31:37.381727 18761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:44551
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:37.411707 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39167
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:33437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:37.740144 19281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:37.740437 19281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:37.740536 19281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:37.747852 19281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:37.747987 19281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:37.748102 19281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:37.758132 19281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:37.759493 19281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:37.760864 19281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:37.775138 19288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:37.775113 19289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:37.775681 19292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:37.776739 19281 server_base.cc:1034] running on GCE node
I20260806 20:31:37.777547 19281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:37.778667 19281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:37.779897 19281 hybrid_clock.cc:648] HybridClock initialized: now 1786048297779836 us; error 54 us; skew 500 ppm
I20260806 20:31:37.780232 19281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:37 dist-test-slave-2kcd krb5kdc[18692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:37.783751 19281 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:37.785267 19281 webserver.cc:460] Webserver started at http://127.13.149.67:40107/ using document root <none> and password file <none>
I20260806 20:31:37.786029 19281 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:37.786141 19281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:37.786405 19281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:37.789817 19281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "6419f0796916421a8e3a157048b13715"
format_stamp: "Formatted at 2026-08-06 20:31:37 on dist-test-slave-2kcd"
server_key: "2c2f8cc4e5b34222c0987742f73e0bff"
server_key_iv: "00eed1bb0316d7987123fa71231c17d5"
server_key_version: "encryptionkey@0"
I20260806 20:31:37.790611 19281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "6419f0796916421a8e3a157048b13715"
format_stamp: "Formatted at 2026-08-06 20:31:37 on dist-test-slave-2kcd"
server_key: "2c2f8cc4e5b34222c0987742f73e0bff"
server_key_iv: "00eed1bb0316d7987123fa71231c17d5"
server_key_version: "encryptionkey@0"
I20260806 20:31:37.795950 19281 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:31:37.799372 19310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:37.800737 19281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:31:37.800997 19281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "6419f0796916421a8e3a157048b13715"
format_stamp: "Formatted at 2026-08-06 20:31:37 on dist-test-slave-2kcd"
server_key: "2c2f8cc4e5b34222c0987742f73e0bff"
server_key_iv: "00eed1bb0316d7987123fa71231c17d5"
server_key_version: "encryptionkey@0"
I20260806 20:31:37.801244 19281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:37.821272 19281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:37.825186 19281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:37.825493 19281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:37.826493 19281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:37.827883 19281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:37.828009 19281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:37.828173 19281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:37.828256 19281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:37.862996 19281 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:42291
I20260806 20:31:37.863031 19482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:42291 every 8 connection(s)
I20260806 20:31:37.864326 19281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:37.873453 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 19281
I20260806 20:31:37.873703 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:37.874161 13909 external_mini_cluster.cc:1428] Setting key 0605a6eecf996808eab25d68dd1421d5
Aug 06 20:31:37 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:37.882980 19071 heartbeater.cc:503] Master 127.13.149.126:39167 was elected leader, sending a full tablet report...
I20260806 20:31:37.884519 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:37.866893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:47305 (local address 127.13.149.126:39167)
0806 20:31:37.867081 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:37.867085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:37.868245 (+ 1160us) server_negotiation.cc:407] Connection header received
0806 20:31:37.870100 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:37.870106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:37.870217 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:37.870336 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:37.872040 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.872873 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.874724 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.875217 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.875362 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:37.878876 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:37.878887 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:37.878891 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:37.878923 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:37.881352 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.882065 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.882077 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.882081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.882203 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.882642 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.882648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.882652 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.882934 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:37.883095 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:37.883905 (+ 810us) server_negotiation.cc:299] Negotiation successful
0806 20:31:37.884130 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:31:37.885524 19485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:37.867377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39167 (local address 127.13.149.67:47305)
0806 20:31:37.868076 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:37.868113 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:37.869828 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:37.870579 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:37.870586 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:37.871268 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:37.871828 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:37.871845 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.873003 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.873007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:37.874547 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:37.874558 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.875464 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.875473 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:37.875719 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:37.876373 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:37.876403 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:37.878672 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:37.881494 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:37.881503 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:37.881518 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:37.881935 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:37.882327 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:37.882332 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:37.882336 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:37.882527 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:37.883068 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:37.883076 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:37.883474 (+ 398us) client_negotiation.cc:769] Sending connection context
0806 20:31:37.883786 (+ 312us) client_negotiation.cc:240] Negotiation successful
0806 20:31:37.884314 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":261,"threads_started":1}
I20260806 20:31:37.886941 19483 heartbeater.cc:347] Connected to a master server at 127.13.149.126:39167
I20260806 20:31:37.887277 19483 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:37.888216 19483 heartbeater.cc:511] Master 127.13.149.126:39167 requested a full tablet report, sending...
I20260806 20:31:37.889914 18761 ts_manager.cc:194] Registered new tserver with Master: 6419f0796916421a8e3a157048b13715 (127.13.149.67:42291)
I20260806 20:31:37.890744 18761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:47305
I20260806 20:31:37.902073 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 20:31:37 dist-test-slave-2kcd krb5kdc[18692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 20:31:37 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:37.959092 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:37.943437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58244 (local address 127.13.149.126:39167)
0806 20:31:37.943701 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:37.943711 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:37.944285 (+ 574us) server_negotiation.cc:407] Connection header received
0806 20:31:37.944541 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:37.944550 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:37.944635 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:37.944760 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:37.946414 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.947220 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.948835 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.949295 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.949453 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:37.953632 (+ 4179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:37.953638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:37.953641 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:37.953676 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:37.956363 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.957088 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.957095 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.957101 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.957254 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.957660 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.957664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.957666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.957984 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:37.958245 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:37.958555 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 20:31:37.958775 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
W20260806 20:31:37.959635 18761 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58244
I20260806 20:31:37.961918 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18861
Aug 06 20:31:37 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:37.978389 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:37.962927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41616 (local address 127.13.149.65:46461)
0806 20:31:37.963608 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:37.963614 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:37.963639 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:31:37.963695 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:37.963702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:37.963908 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:37.964034 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:37.965155 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.966221 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.967650 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:37.968509 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:37.968664 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:37.972656 (+ 3992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:37.972668 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:37.972682 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:37.972716 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:37.975813 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.976451 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.976458 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.976460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.976594 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:37.976986 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:37.976989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:37.976991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:37.977350 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:37.977587 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:37.977789 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 20:31:37.977981 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":354,"threads_started":1}
W20260806 20:31:37.979648 19064 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41616
W20260806 20:31:37.980728 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18861: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:37.981051 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 18861
I20260806 20:31:38.015419 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 19084
Aug 06 20:31:38 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:38.031651 19514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:38.016590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54152 (local address 127.13.149.66:46829)
0806 20:31:38.017290 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:38.017298 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:38.017324 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:31:38.017385 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:38.017391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:38.017617 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:38.017745 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:38.019023 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:38.020098 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:38.021459 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:38.021997 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:38.022102 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:38.026157 (+ 4055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:38.026167 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:38.026182 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:38.026213 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:38.029253 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:38.029846 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:38.029852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:38.029854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:38.029970 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:38.030288 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:38.030291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:38.030293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:38.030615 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:38.030847 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:38.031050 (+ 203us) server_negotiation.cc:299] Negotiation successful
0806 20:31:38.031237 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":410,"threads_started":1}
W20260806 20:31:38.033030 19264 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54152
W20260806 20:31:38.034090 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 19084: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:38.034233 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 19084
I20260806 20:31:38.060127 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 19281
Aug 06 20:31:38 dist-test-slave-2kcd krb5kdc[18692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048297, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:38.077512 19515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:38.061266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46110 (local address 127.13.149.67:42291)
0806 20:31:38.061962 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:38.061969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:38.061998 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:31:38.062059 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:38.062065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:38.062268 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:38.062416 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:38.063668 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:38.064720 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:38.066179 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:38.066910 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:38.067024 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:38.071434 (+ 4410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:38.071445 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:38.071460 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:38.071505 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:38.074654 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:38.075239 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:38.075246 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:38.075248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:38.075410 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:38.075778 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:38.075782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:38.075784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:38.076286 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:38.076548 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:38.076774 (+ 226us) server_negotiation.cc:299] Negotiation successful
0806 20:31:38.077090 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":362,"threads_started":1}
W20260806 20:31:38.078760 19475 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46110
W20260806 20:31:38.079851 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 19281: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:31:38.080027 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 19281
I20260806 20:31:38.106920 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 18706
I20260806 20:31:38.108114 18816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:38.211565 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 18706
2026-08-06T20:31:38Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3950 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:38 dist-test-slave-2kcd krb5kdc[19521](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:38 dist-test-slave-2kcd krb5kdc[19521](info): set up 2 sockets
Aug 06 20:31:38 dist-test-slave-2kcd krb5kdc[19521](info): commencing operation
krb5kdc: starting...
W20260806 20:31:39.520061 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:39 dist-test-slave-2kcd krb5kdc[19521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:39.760056 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:43703
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:43703
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:40.094216 19541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:40.094529 19541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:40.094621 19541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:40.101945 19541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:40.102054 19541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:40.102108 19541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:40.102166 19541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:40.102209 19541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:40.112128 19541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:43703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:43703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:40.113456 19541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:40.114746 19541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:40.127146 19548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:40.127226 19550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:40.127221 19553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:40.128434 19541 server_base.cc:1034] running on GCE node
I20260806 20:31:40.129289 19541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:40.130700 19541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:40.131922 19541 hybrid_clock.cc:648] HybridClock initialized: now 1786048300131880 us; error 36 us; skew 500 ppm
I20260806 20:31:40.132278 19541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:40 dist-test-slave-2kcd krb5kdc[19521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048300, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:40.135438 19541 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:40.136982 19541 webserver.cc:460] Webserver started at http://127.13.149.126:40923/ using document root <none> and password file <none>
I20260806 20:31:40.137686 19541 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:40.137821 19541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:40.138149 19541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:40.141197 19541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "2a6f13c8055049a89921e7b74af8e441"
format_stamp: "Formatted at 2026-08-06 20:31:40 on dist-test-slave-2kcd"
server_key: "91f254a1b48317b76f40cb93fd8aecce"
server_key_iv: "ee3c16c86b6146f30154b607b86ed77c"
server_key_version: "encryptionkey@0"
I20260806 20:31:40.142002 19541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "2a6f13c8055049a89921e7b74af8e441"
format_stamp: "Formatted at 2026-08-06 20:31:40 on dist-test-slave-2kcd"
server_key: "91f254a1b48317b76f40cb93fd8aecce"
server_key_iv: "ee3c16c86b6146f30154b607b86ed77c"
server_key_version: "encryptionkey@0"
I20260806 20:31:40.147145 19541 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:31:40.150713 19566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:40.152009 19541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:31:40.152190 19541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "2a6f13c8055049a89921e7b74af8e441"
format_stamp: "Formatted at 2026-08-06 20:31:40 on dist-test-slave-2kcd"
server_key: "91f254a1b48317b76f40cb93fd8aecce"
server_key_iv: "ee3c16c86b6146f30154b607b86ed77c"
server_key_version: "encryptionkey@0"
I20260806 20:31:40.152405 19541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:40.183023 19541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:40.187427 19541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:40.187736 19541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:40.207509 19638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:43703 every 8 connection(s)
I20260806 20:31:40.207528 19541 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:43703
I20260806 20:31:40.209120 19541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:40.212105 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 19541
I20260806 20:31:40.212392 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:40.213039 19641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:40.213264 13909 external_mini_cluster.cc:1428] Setting key bbd87e8b9ea93d9d456ae1b9d7a0c6e4
I20260806 20:31:40.226999 19641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441: Bootstrap starting.
Aug 06 20:31:40 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:40.230540 19641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:40.231664 19641 log.cc:824] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:40.234903 19641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441: No bootstrap required, opened a new log
I20260806 20:31:40.237747 19644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:40.215523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53182 (local address 127.13.149.126:43703)
0806 20:31:40.216487 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:40.216501 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:40.216549 (+ 48us) server_negotiation.cc:407] Connection header received
0806 20:31:40.218274 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:40.218306 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:40.218776 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:40.219198 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:40.220969 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:40.222823 (+ 1854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:40.224167 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:40.225318 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:40.225487 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:40.230099 (+ 4612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:40.230107 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:40.230121 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:40.230161 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:40.233692 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:40.234537 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:40.234543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:40.234549 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:40.234702 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:40.235126 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:40.235129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:40.235131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:40.235614 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:40.235857 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:40.236321 (+ 464us) server_negotiation.cc:299] Negotiation successful
0806 20:31:40.236691 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":416,"threads_started":1}
I20260806 20:31:40.243300 19641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6f13c8055049a89921e7b74af8e441" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43703 } }
I20260806 20:31:40.243635 19641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:40.243749 19641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a6f13c8055049a89921e7b74af8e441, State: Initialized, Role: FOLLOWER
I20260806 20:31:40.244263 19641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6f13c8055049a89921e7b74af8e441" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43703 } }
I20260806 20:31:40.244493 19641 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:40.244657 19641 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:40.244867 19641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:40.246968 19641 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6f13c8055049a89921e7b74af8e441" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43703 } }
I20260806 20:31:40.247445 19641 leader_election.cc:302] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a6f13c8055049a89921e7b74af8e441; no voters:
I20260806 20:31:40.248028 19641 leader_election.cc:288] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:40.248152 19647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:40.248917 19647 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [term 1 LEADER]: Becoming Leader. State: Replica: 2a6f13c8055049a89921e7b74af8e441, State: Running, Role: LEADER
I20260806 20:31:40.249485 19647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6f13c8055049a89921e7b74af8e441" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43703 } }
I20260806 20:31:40.250200 19641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:40.254076 19650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a6f13c8055049a89921e7b74af8e441" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6f13c8055049a89921e7b74af8e441" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43703 } } }
I20260806 20:31:40.254765 19650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:40.258051 19651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a6f13c8055049a89921e7b74af8e441. Latest consensus state: current_term: 1 leader_uuid: "2a6f13c8055049a89921e7b74af8e441" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6f13c8055049a89921e7b74af8e441" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43703 } } }
I20260806 20:31:40.258409 19651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:40.259833 19656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:40.264539 19656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:40.273401 19656 catalog_manager.cc:1347] Generated new cluster ID: bf7c6c94d9fd409c8fa563fcd24bee34
I20260806 20:31:40.273532 19656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:40.286866 19656 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:40.288097 19656 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:40.301895 19656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a6f13c8055049a89921e7b74af8e441: Generated new TSK 0
I20260806 20:31:40.302663 19656 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:40.356719 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43703
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:40.706384 19681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:40.706647 19681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:40.706740 19681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:40.713577 19681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:40.713667 19681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:40.713781 19681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:40.722738 19681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:40.723800 19681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:40.724997 19681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:40.738359 19689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:40.738641 19690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:40.739019 19692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:40.742573 19681 server_base.cc:1034] running on GCE node
I20260806 20:31:40.743146 19681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:40.744052 19681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:40.745280 19681 hybrid_clock.cc:648] HybridClock initialized: now 1786048300745228 us; error 46 us; skew 500 ppm
I20260806 20:31:40.745599 19681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:40 dist-test-slave-2kcd krb5kdc[19521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048300, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:40.748770 19681 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:40.750312 19681 webserver.cc:460] Webserver started at http://127.13.149.65:40019/ using document root <none> and password file <none>
I20260806 20:31:40.751075 19681 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:40.751200 19681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:40.751562 19681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:40.754470 19681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "c8221f97986b45d4a0d1580f3f6059b1"
format_stamp: "Formatted at 2026-08-06 20:31:40 on dist-test-slave-2kcd"
server_key: "f8138bb0a3da1477a8523039d73dc7ae"
server_key_iv: "f7897e0374bb8c42844a2fca802bed34"
server_key_version: "encryptionkey@0"
I20260806 20:31:40.755278 19681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "c8221f97986b45d4a0d1580f3f6059b1"
format_stamp: "Formatted at 2026-08-06 20:31:40 on dist-test-slave-2kcd"
server_key: "f8138bb0a3da1477a8523039d73dc7ae"
server_key_iv: "f7897e0374bb8c42844a2fca802bed34"
server_key_version: "encryptionkey@0"
I20260806 20:31:40.760496 19681 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s
I20260806 20:31:40.764040 19705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:40.765344 19681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:40.765525 19681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "c8221f97986b45d4a0d1580f3f6059b1"
format_stamp: "Formatted at 2026-08-06 20:31:40 on dist-test-slave-2kcd"
server_key: "f8138bb0a3da1477a8523039d73dc7ae"
server_key_iv: "f7897e0374bb8c42844a2fca802bed34"
server_key_version: "encryptionkey@0"
I20260806 20:31:40.765697 19681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:40.798826 19681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:40.803290 19681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:40.803537 19681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:40.804430 19681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:40.805799 19681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:40.805876 19681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:40.805966 19681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:40.806011 19681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:40.839963 19681 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:43527
I20260806 20:31:40.840058 19858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:43527 every 8 connection(s)
I20260806 20:31:40.841434 19681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:40.851214 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 19681
I20260806 20:31:40.851539 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:40.852370 13909 external_mini_cluster.cc:1428] Setting key d239a19a89f03e5d82781a13fd17ed84
Aug 06 20:31:40 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048300, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:40.863642 19861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:40.844167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:54973 (local address 127.13.149.126:43703)
0806 20:31:40.844629 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:40.844635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:40.845756 (+ 1121us) server_negotiation.cc:407] Connection header received
0806 20:31:40.847568 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:40.847573 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:40.847662 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:40.847762 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:40.849330 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:40.850081 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:40.851894 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:40.852592 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:40.852731 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:40.857116 (+ 4385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:40.857121 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:40.857124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:40.857157 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:40.859797 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:40.860772 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:40.860776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:40.860815 (+ 39us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:40.860964 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:40.861504 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:40.861508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:40.861511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:40.861813 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:40.861946 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:40.862932 (+ 986us) server_negotiation.cc:299] Negotiation successful
0806 20:31:40.863197 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":213,"threads_started":1}
I20260806 20:31:40.864388 19862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:40.844884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43703 (local address 127.13.149.65:54973)
0806 20:31:40.845587 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:40.845628 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:40.847296 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:40.847970 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:40.847977 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:40.848496 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:40.849169 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:40.849187 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:40.850259 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:40.850263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:40.851746 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:40.851759 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:40.852850 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:40.852857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:40.853082 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:40.853916 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:40.853947 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:40.856894 (+ 2947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:40.859944 (+ 3050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:40.859955 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:40.859975 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:40.860628 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:40.861094 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:40.861101 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:40.861107 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:40.861363 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:40.861955 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:40.861966 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:40.862448 (+ 482us) client_negotiation.cc:769] Sending connection context
0806 20:31:40.862786 (+ 338us) client_negotiation.cc:240] Negotiation successful
0806 20:31:40.863238 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":271,"threads_started":1}
I20260806 20:31:40.866009 19859 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43703
I20260806 20:31:40.866339 19859 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:40.867285 19859 heartbeater.cc:511] Master 127.13.149.126:43703 requested a full tablet report, sending...
I20260806 20:31:40.869701 19590 ts_manager.cc:194] Registered new tserver with Master: c8221f97986b45d4a0d1580f3f6059b1 (127.13.149.65:43527)
I20260806 20:31:40.871160 19590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:54973
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:40.907536 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43703
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:41.253304 19867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:41.253615 19867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:41.253818 19867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:41.261540 19867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:41.261653 19867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:41.261876 19867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:41.272086 19867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:41.273415 19867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:41.274763 19867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:41.288331 19874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:41.288267 19873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:41.288306 19880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:41.289275 19867 server_base.cc:1034] running on GCE node
I20260806 20:31:41.289939 19867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:41.290901 19867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:41.292160 19867 hybrid_clock.cc:648] HybridClock initialized: now 1786048301292098 us; error 44 us; skew 500 ppm
I20260806 20:31:41.292501 19867 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:41 dist-test-slave-2kcd krb5kdc[19521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:41.299517 19867 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:41.301090 19867 webserver.cc:460] Webserver started at http://127.13.149.66:34925/ using document root <none> and password file <none>
I20260806 20:31:41.301744 19867 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:41.301913 19867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:41.302222 19867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:41.305131 19867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "1bd61c1564da4ac8aeb760103e242e2e"
format_stamp: "Formatted at 2026-08-06 20:31:41 on dist-test-slave-2kcd"
server_key: "e450a002e3e05eb5bd3b9f6dd54496e6"
server_key_iv: "f0b284c93fd6384d892166751930e6c6"
server_key_version: "encryptionkey@0"
I20260806 20:31:41.305900 19867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "1bd61c1564da4ac8aeb760103e242e2e"
format_stamp: "Formatted at 2026-08-06 20:31:41 on dist-test-slave-2kcd"
server_key: "e450a002e3e05eb5bd3b9f6dd54496e6"
server_key_iv: "f0b284c93fd6384d892166751930e6c6"
server_key_version: "encryptionkey@0"
I20260806 20:31:41.310696 19867 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 20:31:41.314074 19895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:41.315269 19867 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:31:41.315448 19867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "1bd61c1564da4ac8aeb760103e242e2e"
format_stamp: "Formatted at 2026-08-06 20:31:41 on dist-test-slave-2kcd"
server_key: "e450a002e3e05eb5bd3b9f6dd54496e6"
server_key_iv: "f0b284c93fd6384d892166751930e6c6"
server_key_version: "encryptionkey@0"
I20260806 20:31:41.315649 19867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:41.332216 19867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:41.336661 19867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:41.337024 19867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:41.338076 19867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:41.339365 19867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:41.339438 19867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:41.339526 19867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:41.339571 19867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:41.373659 19867 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:35451
I20260806 20:31:41.373696 20070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:35451 every 8 connection(s)
I20260806 20:31:41.374941 19867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:41.380679 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 19867
I20260806 20:31:41.380903 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:41.381469 13909 external_mini_cluster.cc:1428] Setting key ce7a8a28c9ca749f9711b547ff6ebccc
Aug 06 20:31:41 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:41.398269 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:41.377821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:37487 (local address 127.13.149.126:43703)
0806 20:31:41.378318 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:41.378323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:41.379208 (+ 885us) server_negotiation.cc:407] Connection header received
0806 20:31:41.381362 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:41.381366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:41.381447 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:41.381560 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:41.383421 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.384252 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.386846 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.387281 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.387380 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:41.391919 (+ 4539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:41.391931 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:41.391934 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:41.391969 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:41.394818 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.395577 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.395586 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.395593 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.395760 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.396163 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.396171 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.396177 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.396558 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:41.396726 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:41.397491 (+ 765us) server_negotiation.cc:299] Negotiation successful
0806 20:31:41.397769 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":222,"threads_started":1}
I20260806 20:31:41.398864 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:41.378359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43703 (local address 127.13.149.66:37487)
0806 20:31:41.379050 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:41.379089 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:41.381046 (+ 1957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:41.381837 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:41.381849 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:41.382602 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:41.383211 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:41.383237 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.384423 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.384431 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:41.386688 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:41.386706 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.387528 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.387538 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:41.387857 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:41.388603 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:41.388646 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:41.391689 (+ 3043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:41.394947 (+ 3258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:41.394954 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:41.394967 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:41.395426 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:41.395870 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:41.395873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:41.395875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:41.396045 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:41.396686 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:41.396692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:41.397106 (+ 414us) client_negotiation.cc:769] Sending connection context
0806 20:31:41.397341 (+ 235us) client_negotiation.cc:240] Negotiation successful
0806 20:31:41.397718 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":265,"threads_started":1}
I20260806 20:31:41.400437 20071 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43703
I20260806 20:31:41.400751 20071 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:41.401515 20071 heartbeater.cc:511] Master 127.13.149.126:43703 requested a full tablet report, sending...
I20260806 20:31:41.402985 19590 ts_manager.cc:194] Registered new tserver with Master: 1bd61c1564da4ac8aeb760103e242e2e (127.13.149.66:35451)
I20260806 20:31:41.403812 19590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:37487
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:41.435771 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43703
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:41.768334 20083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:41.768669 20083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:41.768879 20083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:41.776379 20083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:41.776481 20083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:41.776692 20083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:41.786481 20083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:41.787838 20083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:41.789281 20083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:41.802731 20091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:41.802778 20090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:41.803356 20094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:41.803440 20083 server_base.cc:1034] running on GCE node
I20260806 20:31:41.804100 20083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:41.805016 20083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:41.806213 20083 hybrid_clock.cc:648] HybridClock initialized: now 1786048301806153 us; error 58 us; skew 500 ppm
I20260806 20:31:41.806530 20083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:41 dist-test-slave-2kcd krb5kdc[19521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:41.809659 20083 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:41.811096 20083 webserver.cc:460] Webserver started at http://127.13.149.67:33861/ using document root <none> and password file <none>
I20260806 20:31:41.811833 20083 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:41.811983 20083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:41.812304 20083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:41.815331 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "07efa0bd6fa1489ea428e588179354b0"
format_stamp: "Formatted at 2026-08-06 20:31:41 on dist-test-slave-2kcd"
server_key: "1d34de0aff7512b1c195bad2c2c6a5d1"
server_key_iv: "d48c484d1922d9ef6fcd39dce3dd527c"
server_key_version: "encryptionkey@0"
I20260806 20:31:41.816102 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "07efa0bd6fa1489ea428e588179354b0"
format_stamp: "Formatted at 2026-08-06 20:31:41 on dist-test-slave-2kcd"
server_key: "1d34de0aff7512b1c195bad2c2c6a5d1"
server_key_iv: "d48c484d1922d9ef6fcd39dce3dd527c"
server_key_version: "encryptionkey@0"
I20260806 20:31:41.821321 20083 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:31:41.824580 20102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:41.825928 20083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:41.826128 20083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "07efa0bd6fa1489ea428e588179354b0"
format_stamp: "Formatted at 2026-08-06 20:31:41 on dist-test-slave-2kcd"
server_key: "1d34de0aff7512b1c195bad2c2c6a5d1"
server_key_iv: "d48c484d1922d9ef6fcd39dce3dd527c"
server_key_version: "encryptionkey@0"
I20260806 20:31:41.826344 20083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:41.837064 20083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:41.840775 20083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:41.841147 20083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:41.842062 20083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:41.843353 20083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:41.843466 20083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:41.843655 20083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:41.843762 20083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 20:31:41.874902 19859 heartbeater.cc:503] Master 127.13.149.126:43703 was elected leader, sending a full tablet report...
I20260806 20:31:41.878754 20083 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:35057
I20260806 20:31:41.878790 20285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:35057 every 8 connection(s)
I20260806 20:31:41.880019 20083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:41.888041 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 20083
I20260806 20:31:41.888240 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:41.888706 13909 external_mini_cluster.cc:1428] Setting key 371ef420d55f389bebbf90f8e8ec8ffb
Aug 06 20:31:41 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:41.899418 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:41.882567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:34673 (local address 127.13.149.126:43703)
0806 20:31:41.882753 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:41.882757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:41.883915 (+ 1158us) server_negotiation.cc:407] Connection header received
0806 20:31:41.885877 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:41.885883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:41.885988 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:41.886100 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:41.887610 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.888484 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.890327 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.890747 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.890897 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:41.894366 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:41.894370 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:41.894373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:41.894404 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:41.896776 (+ 2372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.897496 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.897500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.897502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.897617 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.898029 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.898032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.898034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.898300 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:41.898415 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:41.899030 (+ 615us) server_negotiation.cc:299] Negotiation successful
0806 20:31:41.899193 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:31:41.900364 20290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:41.883059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43703 (local address 127.13.149.67:34673)
0806 20:31:41.883754 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:41.883791 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:41.885620 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:41.886340 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:41.886347 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:41.886922 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:41.887448 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:41.887464 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.888651 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.888655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:41.890179 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:41.890191 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.891076 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.891082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:41.891269 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:41.892000 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:41.892024 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:41.894174 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:41.896959 (+ 2785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:41.896965 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:41.896976 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:41.897388 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:41.897729 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:41.897732 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:41.897734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:41.897907 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:41.898414 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:41.898420 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:41.898707 (+ 287us) client_negotiation.cc:769] Sending connection context
0806 20:31:41.898922 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 20:31:41.899266 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":276,"threads_started":1}
I20260806 20:31:41.901715 20286 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43703
I20260806 20:31:41.901999 20286 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:41.902869 20286 heartbeater.cc:511] Master 127.13.149.126:43703 requested a full tablet report, sending...
I20260806 20:31:41.904420 19590 ts_manager.cc:194] Registered new tserver with Master: 07efa0bd6fa1489ea428e588179354b0 (127.13.149.67:35057)
I20260806 20:31:41.905263 19590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:34673
I20260806 20:31:41.916327 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 20:31:41 dist-test-slave-2kcd krb5kdc[19521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 20:31:41 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:41.971920 20300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:41.956455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.13.149.65:43527)
0806 20:31:41.957135 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:41.957142 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:41.957171 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:31:41.957336 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:41.957343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:41.957583 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:41.957722 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:41.959202 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.960237 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.961542 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.962140 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.962294 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:41.966180 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:41.966192 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:41.966207 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:41.966247 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:41.969390 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.970028 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.970036 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.970038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.970192 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.970597 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.970600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.970602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.970932 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:41.971188 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:41.971424 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 20:31:41.971625 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":377,"threads_started":1}
Aug 06 20:31:41 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:41.989813 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:41.976510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45316 (local address 127.13.149.126:43703)
0806 20:31:41.976755 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:41.976761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:41.977009 (+ 248us) server_negotiation.cc:407] Connection header received
0806 20:31:41.977130 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:41.977134 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:41.977209 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:41.977292 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:41.978462 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.979221 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.980384 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.980931 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.981023 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:41.984698 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:41.984703 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:41.984706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:41.984738 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:41.987417 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.988031 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.988035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.988037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.988161 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:41.988462 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:41.988465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:41.988466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:41.988774 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:41.989051 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:41.989275 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 20:31:41.989446 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
W20260806 20:31:41.990553 19590 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45316
I20260806 20:31:41.991487 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 19681
I20260806 20:31:42.004720 20300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:41.992513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43820 (local address 127.13.149.65:43527)
0806 20:31:41.992727 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:41.992733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:41.992955 (+ 222us) server_negotiation.cc:407] Connection header received
0806 20:31:41.993150 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:41.993156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:41.993254 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:41.993359 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:41.994587 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.995284 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.996719 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:41.997213 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:41.997352 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:41.999613 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:41.999620 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:41.999624 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:41.999663 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:42.002192 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:42.002821 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:42.002828 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:42.002832 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:42.002963 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:42.003332 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:42.003337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:42.003341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:42.003599 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:42.003848 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:42.004175 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 20:31:42.004417 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:31:42.005398 19854 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:42.089856 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 19681
I20260806 20:31:42.118561 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 19867
Aug 06 20:31:42 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:42.135520 20307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:42.119685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35094 (local address 127.13.149.66:35451)
0806 20:31:42.120309 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:42.120316 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:42.120343 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:31:42.120415 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:42.120421 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:42.120646 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:42.120871 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:42.122134 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:42.123168 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:42.124378 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:42.125041 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:42.125180 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:42.129590 (+ 4410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:42.129601 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:42.129617 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:42.129650 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:42.132584 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:42.133294 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:42.133302 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:42.133305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:42.133440 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:42.133869 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:42.133873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:42.133875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:42.134223 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:42.134556 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:42.134883 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 20:31:42.135152 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":356,"threads_started":1}
I20260806 20:31:42.137061 20062 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:42.223397 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 19867
I20260806 20:31:42.250519 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 20083
Aug 06 20:31:42 dist-test-slave-2kcd krb5kdc[19521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:42.279462 20310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:42.252013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46096 (local address 127.13.149.67:35057)
0806 20:31:42.253030 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:42.253040 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:42.253086 (+ 46us) server_negotiation.cc:407] Connection header received
0806 20:31:42.253175 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:42.253184 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:42.253483 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:42.255547 (+ 2064us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:42.255875 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:42.257911 (+ 2036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:42.260029 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:42.261150 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:42.262014 (+ 864us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:42.268776 (+ 6762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:42.268829 (+ 53us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:42.268851 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:42.268902 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:42.275361 (+ 6459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:42.276498 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:42.276509 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:42.276518 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:42.276717 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:42.277293 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:42.277299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:42.277304 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:42.277818 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:42.278187 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:42.278678 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 20:31:42.278978 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":476,"threads_started":1}
I20260806 20:31:42.282665 20280 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:42.383513 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 20083
I20260806 20:31:42.406132 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 19541
I20260806 20:31:42.407471 19633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:42.515444 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 19541
2026-08-06T20:31:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4300 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:42 dist-test-slave-2kcd krb5kdc[20317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:42 dist-test-slave-2kcd krb5kdc[20317](info): set up 2 sockets
Aug 06 20:31:42 dist-test-slave-2kcd krb5kdc[20317](info): commencing operation
krb5kdc: starting...
W20260806 20:31:43.824249 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.001s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:43 dist-test-slave-2kcd krb5kdc[20317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:44.058476 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35225
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:35225
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:44.394172 20342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:44.394448 20342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:44.394541 20342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:44.401960 20342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:44.402102 20342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:44.402187 20342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:44.402273 20342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:44.402343 20342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:44.413794 20342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:35225
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:44.415069 20342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:44.416320 20342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:44.428253 20349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:44.428195 20350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:44.428268 20353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:44.429145 20342 server_base.cc:1034] running on GCE node
I20260806 20:31:44.429970 20342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:44.431306 20342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:44.432515 20342 hybrid_clock.cc:648] HybridClock initialized: now 1786048304432472 us; error 34 us; skew 500 ppm
I20260806 20:31:44.432914 20342 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:44 dist-test-slave-2kcd krb5kdc[20317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048304, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:44.436028 20342 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:44.437253 20342 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:44.437386 20342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:44.437747 20342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:44.441015 20342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "2598a7725069447ea138af4b11b36ef3"
format_stamp: "Formatted at 2026-08-06 20:31:44 on dist-test-slave-2kcd"
server_key: "0196d55a28a54a8111cb25e71674adb1"
server_key_iv: "bbbe1c78e5ab289f1a7f51fab59ac6da"
server_key_version: "encryptionkey@0"
I20260806 20:31:44.441857 20342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "2598a7725069447ea138af4b11b36ef3"
format_stamp: "Formatted at 2026-08-06 20:31:44 on dist-test-slave-2kcd"
server_key: "0196d55a28a54a8111cb25e71674adb1"
server_key_iv: "bbbe1c78e5ab289f1a7f51fab59ac6da"
server_key_version: "encryptionkey@0"
I20260806 20:31:44.447161 20342 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260806 20:31:44.450730 20365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:44.452073 20342 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 20:31:44.452260 20342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "2598a7725069447ea138af4b11b36ef3"
format_stamp: "Formatted at 2026-08-06 20:31:44 on dist-test-slave-2kcd"
server_key: "0196d55a28a54a8111cb25e71674adb1"
server_key_iv: "bbbe1c78e5ab289f1a7f51fab59ac6da"
server_key_version: "encryptionkey@0"
I20260806 20:31:44.452510 20342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:44.473907 20342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:44.478091 20342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:44.478390 20342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:44.497329 20342 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:35225
I20260806 20:31:44.497370 20435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:35225 every 8 connection(s)
I20260806 20:31:44.498282 20342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:44.500914 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 20342
I20260806 20:31:44.501163 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:44.502013 13909 external_mini_cluster.cc:1428] Setting key 2bbcff70028f60ab3be10fcd3c5e879b
I20260806 20:31:44.502552 20436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:44.517208 20436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3: Bootstrap starting.
Aug 06 20:31:44 dist-test-slave-2kcd krb5kdc[20317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:44.521003 20436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:44.522059 20436 log.cc:824] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:44.525230 20436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3: No bootstrap required, opened a new log
I20260806 20:31:44.526194 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:44.504169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43054 (local address 127.13.149.126:35225)
0806 20:31:44.504991 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:44.505009 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:44.505051 (+ 42us) server_negotiation.cc:407] Connection header received
0806 20:31:44.507234 (+ 2183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:44.507259 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:44.507629 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:44.507949 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:44.509865 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:44.511179 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:44.512998 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:44.513696 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:44.513834 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:44.518881 (+ 5047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:44.518891 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:44.518904 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:44.518953 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:44.522004 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:44.522852 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:44.522860 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:44.522868 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:44.523112 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:44.523503 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:44.523507 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:44.523509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:44.523986 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:44.524200 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:44.524682 (+ 482us) server_negotiation.cc:299] Negotiation successful
0806 20:31:44.525179 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":391,"threads_started":1}
I20260806 20:31:44.533332 20436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2598a7725069447ea138af4b11b36ef3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35225 } }
I20260806 20:31:44.533690 20436 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:44.533795 20436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2598a7725069447ea138af4b11b36ef3, State: Initialized, Role: FOLLOWER
I20260806 20:31:44.534348 20436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2598a7725069447ea138af4b11b36ef3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35225 } }
I20260806 20:31:44.534591 20436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:44.534730 20436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:44.534894 20436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:44.537035 20436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2598a7725069447ea138af4b11b36ef3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35225 } }
I20260806 20:31:44.537505 20436 leader_election.cc:302] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2598a7725069447ea138af4b11b36ef3; no voters:
I20260806 20:31:44.538062 20436 leader_election.cc:288] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:44.538152 20444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:44.539055 20444 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [term 1 LEADER]: Becoming Leader. State: Replica: 2598a7725069447ea138af4b11b36ef3, State: Running, Role: LEADER
I20260806 20:31:44.539712 20444 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2598a7725069447ea138af4b11b36ef3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35225 } }
I20260806 20:31:44.540257 20436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:44.542846 20446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2598a7725069447ea138af4b11b36ef3. Latest consensus state: current_term: 1 leader_uuid: "2598a7725069447ea138af4b11b36ef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2598a7725069447ea138af4b11b36ef3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35225 } } }
I20260806 20:31:44.542872 20445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2598a7725069447ea138af4b11b36ef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2598a7725069447ea138af4b11b36ef3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35225 } } }
I20260806 20:31:44.543339 20445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:44.543345 20446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:44.545648 20454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:44.552536 20454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:44.561623 20454 catalog_manager.cc:1347] Generated new cluster ID: 6e96d9c0fa92473894fbc0d5cb35fe4a
I20260806 20:31:44.561733 20454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:44.572682 20454 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:44.573930 20454 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:44.583880 20454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3: Generated new TSK 0
I20260806 20:31:44.584650 20454 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:44.646646 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35225
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:44.982304 20475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:44.982575 20475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:44.982780 20475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:44.989886 20475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:44.989984 20475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:44.990095 20475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:44.999634 20475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35225
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:45.000941 20475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:45.002215 20475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:45.015079 20484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:45.015079 20486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:45.015208 20489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:45.015815 20475 server_base.cc:1034] running on GCE node
I20260806 20:31:45.016410 20475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:45.017354 20475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:45.018554 20475 hybrid_clock.cc:648] HybridClock initialized: now 1786048305018522 us; error 37 us; skew 500 ppm
I20260806 20:31:45.018826 20475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:45 dist-test-slave-2kcd krb5kdc[20317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048305, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:45.021965 20475 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:45.023083 20475 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:45.023195 20475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:45.023558 20475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:45.026846 20475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "eceba56e080f4637862501de0e6392f6"
format_stamp: "Formatted at 2026-08-06 20:31:45 on dist-test-slave-2kcd"
server_key: "fc82627377db080abb5350dbb2048994"
server_key_iv: "f926b8cac571bef641b5f0243feb6c8f"
server_key_version: "encryptionkey@0"
I20260806 20:31:45.027674 20475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "eceba56e080f4637862501de0e6392f6"
format_stamp: "Formatted at 2026-08-06 20:31:45 on dist-test-slave-2kcd"
server_key: "fc82627377db080abb5350dbb2048994"
server_key_iv: "f926b8cac571bef641b5f0243feb6c8f"
server_key_version: "encryptionkey@0"
I20260806 20:31:45.032629 20475 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 20:31:45.035972 20500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:45.037314 20475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:45.037484 20475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "eceba56e080f4637862501de0e6392f6"
format_stamp: "Formatted at 2026-08-06 20:31:45 on dist-test-slave-2kcd"
server_key: "fc82627377db080abb5350dbb2048994"
server_key_iv: "f926b8cac571bef641b5f0243feb6c8f"
server_key_version: "encryptionkey@0"
I20260806 20:31:45.037707 20475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:45.053236 20475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:45.057482 20475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:45.057765 20475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:45.058763 20475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:45.060118 20475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:45.060235 20475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:45.060357 20475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:45.060459 20475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:45.094703 20475 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:44897
I20260806 20:31:45.094764 20674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:44897 every 8 connection(s)
I20260806 20:31:45.095618 20475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:45.101037 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 20475
I20260806 20:31:45.101261 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:45.101929 13909 external_mini_cluster.cc:1428] Setting key d6a848595df1222091797af1982ea3be
Aug 06 20:31:45 dist-test-slave-2kcd krb5kdc[20317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048305, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:45.115933 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:45.098410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:38741 (local address 127.13.149.126:35225)
0806 20:31:45.098861 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:45.098865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:45.099880 (+ 1015us) server_negotiation.cc:407] Connection header received
0806 20:31:45.101898 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:45.101904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:45.102013 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:45.102151 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:45.103896 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.104591 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.106227 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.106639 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.106778 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:45.110265 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:45.110270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:45.110273 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:45.110305 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:45.112873 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:45.113611 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:45.113617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:45.113627 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:45.113745 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:45.114175 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:45.114180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:45.114183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:45.114448 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:45.114614 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:45.115308 (+ 694us) server_negotiation.cc:299] Negotiation successful
0806 20:31:45.115541 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":228,"threads_started":1}
I20260806 20:31:45.116950 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:45.098997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35225 (local address 127.13.149.65:38741)
0806 20:31:45.099710 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:45.099749 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:45.101614 (+ 1865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:45.102386 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:45.102394 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:45.103056 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:45.103718 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:45.103744 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.104748 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.104755 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:45.106061 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:45.106073 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.106884 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.106894 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:45.107121 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:45.107817 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:45.107840 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:45.110039 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:45.113028 (+ 2989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:45.113037 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:45.113052 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:45.113481 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:45.113860 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:45.113865 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:45.113868 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:45.114052 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:45.114589 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:45.114597 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:45.114934 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 20:31:45.115193 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 20:31:45.115728 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":290,"threads_started":1}
I20260806 20:31:45.118559 20675 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35225
I20260806 20:31:45.118883 20675 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:45.119727 20675 heartbeater.cc:511] Master 127.13.149.126:35225 requested a full tablet report, sending...
I20260806 20:31:45.122208 20385 ts_manager.cc:194] Registered new tserver with Master: eceba56e080f4637862501de0e6392f6 (127.13.149.65:44897)
I20260806 20:31:45.124442 20385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:38741
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:45.154239 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35225
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:45.487228 20685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:45.487496 20685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:45.487655 20685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:45.494863 20685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:45.494987 20685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:45.495172 20685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:45.504649 20685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35225
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:45.505860 20685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:45.507091 20685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:45.519831 20694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:45.519865 20695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:45.519891 20697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:45.520529 20685 server_base.cc:1034] running on GCE node
I20260806 20:31:45.521190 20685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:45.522109 20685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:45.523334 20685 hybrid_clock.cc:648] HybridClock initialized: now 1786048305523294 us; error 52 us; skew 500 ppm
I20260806 20:31:45.523671 20685 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:45 dist-test-slave-2kcd krb5kdc[20317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048305, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:45.526757 20685 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:45.527894 20685 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:45.528043 20685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:45.528352 20685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:45.531287 20685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "89fad8c6af4f4848a5dc944f1b90c389"
format_stamp: "Formatted at 2026-08-06 20:31:45 on dist-test-slave-2kcd"
server_key: "e1640afd2346813e532ee1200eaadd17"
server_key_iv: "97a6445bc72893c0df3309b509fc8fd1"
server_key_version: "encryptionkey@0"
I20260806 20:31:45.532104 20685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "89fad8c6af4f4848a5dc944f1b90c389"
format_stamp: "Formatted at 2026-08-06 20:31:45 on dist-test-slave-2kcd"
server_key: "e1640afd2346813e532ee1200eaadd17"
server_key_iv: "97a6445bc72893c0df3309b509fc8fd1"
server_key_version: "encryptionkey@0"
I20260806 20:31:45.536988 20685 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 20:31:45.540278 20707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:45.541883 20685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:45.542124 20685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "89fad8c6af4f4848a5dc944f1b90c389"
format_stamp: "Formatted at 2026-08-06 20:31:45 on dist-test-slave-2kcd"
server_key: "e1640afd2346813e532ee1200eaadd17"
server_key_iv: "97a6445bc72893c0df3309b509fc8fd1"
server_key_version: "encryptionkey@0"
I20260806 20:31:45.542362 20685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:45.573644 20685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:45.577684 20685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:45.577976 20685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:45.579026 20685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:45.580377 20685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:45.580499 20685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:45.580633 20685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:45.580729 20685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:45.614305 20685 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:45529
I20260806 20:31:45.614382 20897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:45529 every 8 connection(s)
I20260806 20:31:45.615187 20685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:45.615527 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 20685
I20260806 20:31:45.615746 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:45.616389 13909 external_mini_cluster.cc:1428] Setting key cb4e20d7096cab147904cb0a2480f73d
Aug 06 20:31:45 dist-test-slave-2kcd krb5kdc[20317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048305, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:45.638653 20901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:45.618285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:46263 (local address 127.13.149.126:35225)
0806 20:31:45.618776 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:45.618782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:45.620030 (+ 1248us) server_negotiation.cc:407] Connection header received
0806 20:31:45.622032 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:45.622041 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:45.622133 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:45.622261 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:45.623740 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.625005 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.626553 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.627309 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.627427 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:45.631659 (+ 4232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:45.631667 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:45.631675 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:45.631721 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:45.635326 (+ 3605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:45.636027 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:45.636035 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:45.636041 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:45.636212 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:45.636622 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:45.636629 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:45.636635 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:45.637062 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:45.637216 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:45.637877 (+ 661us) server_negotiation.cc:299] Negotiation successful
0806 20:31:45.638143 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":267,"threads_started":1}
I20260806 20:31:45.639385 20902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:45.619017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35225 (local address 127.13.149.66:46263)
0806 20:31:45.619846 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:45.619893 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:45.621754 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:45.622462 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:45.622469 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:45.622990 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:45.623557 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:45.623575 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.625155 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.625159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:45.626394 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:45.626406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:45.627588 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:45.627598 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:45.627906 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:45.628681 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:45.628722 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:45.631399 (+ 2677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:45.635476 (+ 4077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:45.635483 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:45.635496 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:45.635899 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:45.636322 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:45.636325 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:45.636327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:45.636505 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:45.637193 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:45.637199 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:45.637515 (+ 316us) client_negotiation.cc:769] Sending connection context
0806 20:31:45.637752 (+ 237us) client_negotiation.cc:240] Negotiation successful
0806 20:31:45.638131 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":355,"threads_started":1}
I20260806 20:31:45.641211 20899 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35225
I20260806 20:31:45.641568 20899 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:45.642336 20899 heartbeater.cc:511] Master 127.13.149.126:35225 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
I20260806 20:31:45.644032 20385 ts_manager.cc:194] Registered new tserver with Master: 89fad8c6af4f4848a5dc944f1b90c389 (127.13.149.66:45529)
I20260806 20:31:45.645013 20385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:46263
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:45.673184 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35225
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:46.012190 20905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:46.012463 20905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:46.012567 20905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:46.019804 20905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:46.019915 20905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:46.020047 20905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:46.030473 20905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35225
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:46.031786 20905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:46.033345 20905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:46.047060 20911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:46.047010 20916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:46.047065 20912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:46.047987 20905 server_base.cc:1034] running on GCE node
I20260806 20:31:46.048520 20905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:46.049589 20905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:46.050818 20905 hybrid_clock.cc:648] HybridClock initialized: now 1786048306050755 us; error 77 us; skew 500 ppm
I20260806 20:31:46.051167 20905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:46 dist-test-slave-2kcd krb5kdc[20317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048306, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:46.054479 20905 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:46.055691 20905 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:46.055878 20905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:46.056236 20905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:46.059453 20905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "642843211c1e4e7cbd2f305b92404f13"
format_stamp: "Formatted at 2026-08-06 20:31:46 on dist-test-slave-2kcd"
server_key: "ad939e1280408ce19d949dae0f4b6cf4"
server_key_iv: "93a4b41230377698565447502e0ad9fc"
server_key_version: "encryptionkey@0"
I20260806 20:31:46.060292 20905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "642843211c1e4e7cbd2f305b92404f13"
format_stamp: "Formatted at 2026-08-06 20:31:46 on dist-test-slave-2kcd"
server_key: "ad939e1280408ce19d949dae0f4b6cf4"
server_key_iv: "93a4b41230377698565447502e0ad9fc"
server_key_version: "encryptionkey@0"
I20260806 20:31:46.065526 20905 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:31:46.069170 20923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:46.070540 20905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:31:46.070724 20905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "642843211c1e4e7cbd2f305b92404f13"
format_stamp: "Formatted at 2026-08-06 20:31:46 on dist-test-slave-2kcd"
server_key: "ad939e1280408ce19d949dae0f4b6cf4"
server_key_iv: "93a4b41230377698565447502e0ad9fc"
server_key_version: "encryptionkey@0"
I20260806 20:31:46.070964 20905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:46.102348 20905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:46.106832 20905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:46.107137 20905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:46.108107 20905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:46.109550 20905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:46.109676 20905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:46.109812 20905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:46.109915 20905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:46.127779 20675 heartbeater.cc:503] Master 127.13.149.126:35225 was elected leader, sending a full tablet report...
I20260806 20:31:46.143492 20905 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:40167
I20260806 20:31:46.143576 21098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:40167 every 8 connection(s)
I20260806 20:31:46.144354 20905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:46.146822 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 20905
I20260806 20:31:46.147049 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:46.147603 13909 external_mini_cluster.cc:1428] Setting key 87b9b438aa6aa6cbb7beb784256146de
Aug 06 20:31:46 dist-test-slave-2kcd krb5kdc[20317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048306, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:46.164381 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.146704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44123 (local address 127.13.149.126:35225)
0806 20:31:46.147399 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.147403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.148426 (+ 1023us) server_negotiation.cc:407] Connection header received
0806 20:31:46.150795 (+ 2369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.150800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.150904 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.151043 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:46.152491 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.153318 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.154868 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.155282 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.155416 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.158923 (+ 3507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:46.158928 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:46.158931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:46.158961 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:46.161422 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.162266 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.162273 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.162276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.162400 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.162839 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.162843 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.162845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.163216 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:46.163336 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.163960 (+ 624us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.164116 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":478,"threads_started":1}
I20260806 20:31:46.165261 21105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.147403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35225 (local address 127.13.149.67:44123)
0806 20:31:46.148210 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:46.148272 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:46.150557 (+ 2285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:46.151273 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:46.151281 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:46.151778 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:46.152319 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.152340 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.153471 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.153477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.154710 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.154722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.155500 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.155507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.155727 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.156411 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:46.156433 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:46.158720 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:46.161590 (+ 2870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:46.161599 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:46.161613 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:46.162147 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:46.162513 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:46.162521 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:46.162525 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:46.162700 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:46.163339 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:46.163346 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:46.163637 (+ 291us) client_negotiation.cc:769] Sending connection context
0806 20:31:46.163863 (+ 226us) client_negotiation.cc:240] Negotiation successful
0806 20:31:46.164206 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":349,"threads_started":1}
I20260806 20:31:46.166540 21100 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35225
I20260806 20:31:46.166797 21100 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:46.167361 21100 heartbeater.cc:511] Master 127.13.149.126:35225 requested a full tablet report, sending...
I20260806 20:31:46.168684 20385 ts_manager.cc:194] Registered new tserver with Master: 642843211c1e4e7cbd2f305b92404f13 (127.13.149.67:40167)
I20260806 20:31:46.169458 20385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:44123
I20260806 20:31:46.175156 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:31:46.191648 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.179541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43064 (local address 127.13.149.126:35225)
0806 20:31:46.179690 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.179694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.180176 (+ 482us) server_negotiation.cc:407] Connection header received
0806 20:31:46.180359 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.180364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.180429 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.180540 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:46.182053 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.182746 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.183995 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.184388 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.184540 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.186759 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:46.186764 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:46.186767 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:46.186795 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:46.189152 (+ 2357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.189768 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.189775 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.189778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.189893 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.190266 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.190274 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.190277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.190578 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:46.190831 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.191135 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.191347 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 20:31:46.195235 20385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:46.201879 20385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:46.240204 21119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.214058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.13.149.67:40167)
0806 20:31:46.231471 (+ 17413us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.231480 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.231521 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:31:46.231615 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.231622 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.231814 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.232740 (+ 926us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:46.233053 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.234709 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.237271 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.238896 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.239071 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.239348 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.239621 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.239795 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17252,"thread_start_us":17084,"threads_started":1}
I20260806 20:31:46.240357 21118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.214302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44897 (local address 127.0.0.1:44756)
0806 20:31:46.224684 (+ 10382us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:46.224707 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:46.224853 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:46.231944 (+ 7091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:46.231953 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:46.231991 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:46.232502 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.232520 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.234856 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.234862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.237337 (+ 2475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.237353 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.239486 (+ 2133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.239491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.239687 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.239719 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 20:31:46.239805 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 20:31:46.239934 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10213,"mutex_wait_us":62,"thread_start_us":9228,"threads_started":1}
I20260806 20:31:46.240911 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.229513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:45529 (local address 127.0.0.1:44686)
0806 20:31:46.233084 (+ 3571us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:46.233098 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:46.233239 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:46.234040 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:46.234044 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:46.234062 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:46.234341 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.234348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.236220 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.236225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.238180 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.238192 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.240014 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.240022 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.240242 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.240272 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 20:31:46.240380 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 20:31:46.240499 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3460,"mutex_wait_us":159,"thread_start_us":3319,"threads_started":1}
I20260806 20:31:46.241245 21121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.215044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44756 (local address 127.13.149.65:44897)
0806 20:31:46.229494 (+ 14450us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.229518 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.229556 (+ 38us) server_negotiation.cc:407] Connection header received
0806 20:31:46.229681 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.231391 (+ 1710us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.231681 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.232731 (+ 1050us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:46.233041 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.234709 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.237539 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.239026 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.239169 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.239350 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.240670 (+ 1320us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.240879 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14198,"thread_start_us":14009,"threads_started":1}
I20260806 20:31:46.241425 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.213868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:40167 (local address 127.0.0.1:50566)
0806 20:31:46.223929 (+ 10061us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:46.223968 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:46.224175 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:46.232020 (+ 7845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:46.232024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:46.232046 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:46.232558 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.232568 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.234913 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.234917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.237103 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.237116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.239142 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.239148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.239338 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.239389 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 20:31:46.239560 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 20:31:46.239756 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9822,"mutex_wait_us":58,"thread_start_us":10462,"threads_started":1}
I20260806 20:31:46.242673 21122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.225123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44686 (local address 127.13.149.66:45529)
0806 20:31:46.232760 (+ 7637us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.232770 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.233208 (+ 438us) server_negotiation.cc:407] Connection header received
0806 20:31:46.233418 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.233424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.233584 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.233772 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:46.234516 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.236033 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.238343 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.239561 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.239681 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.239844 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.241226 (+ 1382us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.241423 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7479,"thread_start_us":7375,"threads_started":1}
I20260806 20:31:46.245329 20578 tablet_service.cc:1467] Processing CreateTablet for tablet ba83f724c76942d7a408efdefc316393 (DEFAULT_TABLE table=test-table [id=4f73c101afb04ae8a4fb77bb71ebf0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:46.245352 20999 tablet_service.cc:1467] Processing CreateTablet for tablet ba83f724c76942d7a408efdefc316393 (DEFAULT_TABLE table=test-table [id=4f73c101afb04ae8a4fb77bb71ebf0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:46.246003 20789 tablet_service.cc:1467] Processing CreateTablet for tablet ba83f724c76942d7a408efdefc316393 (DEFAULT_TABLE table=test-table [id=4f73c101afb04ae8a4fb77bb71ebf0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:46.246803 20999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba83f724c76942d7a408efdefc316393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:46.246819 20578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba83f724c76942d7a408efdefc316393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:46.247242 20789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba83f724c76942d7a408efdefc316393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:46.262359 21124 tablet_bootstrap.cc:492] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Bootstrap starting.
I20260806 20:31:46.263625 21125 tablet_bootstrap.cc:492] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Bootstrap starting.
I20260806 20:31:46.267287 21124 tablet_bootstrap.cc:654] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:46.268313 21125 tablet_bootstrap.cc:654] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:46.268388 21124 log.cc:824] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:46.269831 21125 log.cc:824] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:46.269927 21126 tablet_bootstrap.cc:492] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Bootstrap starting.
I20260806 20:31:46.272065 21124 tablet_bootstrap.cc:492] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: No bootstrap required, opened a new log
I20260806 20:31:46.272377 21124 ts_tablet_manager.cc:1397] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 20:31:46.273131 21125 tablet_bootstrap.cc:492] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: No bootstrap required, opened a new log
I20260806 20:31:46.273396 21125 ts_tablet_manager.cc:1397] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260806 20:31:46.273583 21126 tablet_bootstrap.cc:654] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:46.274787 21126 log.cc:824] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:46.278134 21126 tablet_bootstrap.cc:492] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: No bootstrap required, opened a new log
I20260806 20:31:46.278393 21126 ts_tablet_manager.cc:1397] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 20:31:46.282512 21125 raft_consensus.cc:348] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.282895 21125 raft_consensus.cc:374] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:46.282998 21125 raft_consensus.cc:729] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fad8c6af4f4848a5dc944f1b90c389, State: Initialized, Role: FOLLOWER
I20260806 20:31:46.283043 21124 raft_consensus.cc:348] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.283445 21124 raft_consensus.cc:374] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:46.283557 21124 raft_consensus.cc:729] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642843211c1e4e7cbd2f305b92404f13, State: Initialized, Role: FOLLOWER
I20260806 20:31:46.283682 21125 consensus_queue.cc:260] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.284104 21124 consensus_queue.cc:260] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.285018 20899 heartbeater.cc:503] Master 127.13.149.126:35225 was elected leader, sending a full tablet report...
I20260806 20:31:46.285722 21125 ts_tablet_manager.cc:1428] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260806 20:31:46.289451 21100 heartbeater.cc:503] Master 127.13.149.126:35225 was elected leader, sending a full tablet report...
I20260806 20:31:46.290175 21126 raft_consensus.cc:348] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.290596 21126 raft_consensus.cc:374] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:46.290686 21126 raft_consensus.cc:729] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eceba56e080f4637862501de0e6392f6, State: Initialized, Role: FOLLOWER
I20260806 20:31:46.291399 21124 ts_tablet_manager.cc:1428] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Time spent starting tablet: real 0.019s user 0.016s sys 0.004s
I20260806 20:31:46.291260 21126 consensus_queue.cc:260] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.292840 21126 ts_tablet_manager.cc:1428] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260806 20:31:46.345682 21134 raft_consensus.cc:482] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:46.346163 21134 raft_consensus.cc:504] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
W20260806 20:31:46.347994 20676 tablet.cc:2369] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:31:46.348229 21134 leader_election.cc:288] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89fad8c6af4f4848a5dc944f1b90c389 (127.13.149.66:45529), eceba56e080f4637862501de0e6392f6 (127.13.149.65:44897)
I20260806 20:31:46.355583 21122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.349190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:38477 (local address 127.13.149.66:45529)
0806 20:31:46.349508 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.349514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.349535 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:31:46.349618 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.349623 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.349682 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.349794 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:46.350273 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.351139 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.353349 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.354576 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.354754 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.354813 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.355196 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.355308 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260806 20:31:46.355685 21105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.348475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:45529 (local address 127.13.149.67:38477)
0806 20:31:46.348819 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:46.348841 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:46.348993 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:46.349823 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:46.349828 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:46.349856 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:46.350078 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.350093 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.351245 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.351250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.353173 (+ 1923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.353188 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.354773 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.354779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.354986 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.355026 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 20:31:46.355142 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 20:31:46.355291 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":3}
I20260806 20:31:46.356863 20824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba83f724c76942d7a408efdefc316393" candidate_uuid: "642843211c1e4e7cbd2f305b92404f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fad8c6af4f4848a5dc944f1b90c389" is_pre_election: true
I20260806 20:31:46.357091 21136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.348820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44897 (local address 127.13.149.67:57775)
0806 20:31:46.350008 (+ 1188us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:46.350029 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:46.350190 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:46.350653 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:46.350657 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:46.350681 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:31:46.350990 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.350999 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.352512 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.352516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.354564 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:46.354577 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.356194 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.356200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:46.356396 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.356439 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 20:31:46.356526 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 20:31:46.356691 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1041,"thread_start_us":820,"threads_started":1}
I20260806 20:31:46.357348 21121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.349139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:57775 (local address 127.13.149.65:44897)
0806 20:31:46.349497 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.349504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.350125 (+ 621us) server_negotiation.cc:407] Connection header received
0806 20:31:46.350403 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.350413 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.350528 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.350635 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:31:46.351155 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.352329 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.354761 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.356020 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.356192 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.356896 (+ 704us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.356944 (+ 48us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.357067 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191}
I20260806 20:31:46.357542 20824 raft_consensus.cc:2454] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 642843211c1e4e7cbd2f305b92404f13 in term 0.
I20260806 20:31:46.358357 20928 leader_election.cc:302] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642843211c1e4e7cbd2f305b92404f13, 89fad8c6af4f4848a5dc944f1b90c389; no voters:
I20260806 20:31:46.358393 20606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba83f724c76942d7a408efdefc316393" candidate_uuid: "642843211c1e4e7cbd2f305b92404f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eceba56e080f4637862501de0e6392f6" is_pre_election: true
I20260806 20:31:46.358790 21134 raft_consensus.cc:2781] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:46.358945 21134 raft_consensus.cc:482] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:46.359079 21134 raft_consensus.cc:3037] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:46.358999 20606 raft_consensus.cc:2454] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 642843211c1e4e7cbd2f305b92404f13 in term 0.
I20260806 20:31:46.361577 21134 raft_consensus.cc:504] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.362295 21134 leader_election.cc:288] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [CANDIDATE]: Term 1 election: Requested vote from peers 89fad8c6af4f4848a5dc944f1b90c389 (127.13.149.66:45529), eceba56e080f4637862501de0e6392f6 (127.13.149.65:44897)
I20260806 20:31:46.362768 20824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba83f724c76942d7a408efdefc316393" candidate_uuid: "642843211c1e4e7cbd2f305b92404f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fad8c6af4f4848a5dc944f1b90c389"
I20260806 20:31:46.362862 20606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba83f724c76942d7a408efdefc316393" candidate_uuid: "642843211c1e4e7cbd2f305b92404f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eceba56e080f4637862501de0e6392f6"
I20260806 20:31:46.362998 20824 raft_consensus.cc:3037] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:46.363125 20606 raft_consensus.cc:3037] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:46.365463 20824 raft_consensus.cc:2454] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642843211c1e4e7cbd2f305b92404f13 in term 1.
I20260806 20:31:46.365899 20928 leader_election.cc:302] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642843211c1e4e7cbd2f305b92404f13, 89fad8c6af4f4848a5dc944f1b90c389; no voters:
I20260806 20:31:46.365859 20606 raft_consensus.cc:2454] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642843211c1e4e7cbd2f305b92404f13 in term 1.
I20260806 20:31:46.366231 21134 raft_consensus.cc:2781] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:46.366715 21134 raft_consensus.cc:686] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 1 LEADER]: Becoming Leader. State: Replica: 642843211c1e4e7cbd2f305b92404f13, State: Running, Role: LEADER
W20260806 20:31:46.367259 20900 tablet.cc:2369] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:31:46.367602 21134 consensus_queue.cc:237] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } }
I20260806 20:31:46.372970 20384 catalog_manager.cc:5495] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 642843211c1e4e7cbd2f305b92404f13 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "642843211c1e4e7cbd2f305b92404f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642843211c1e4e7cbd2f305b92404f13" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 40167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 } health_report { overall_health: UNKNOWN } } }
W20260806 20:31:46.396057 21103 tablet.cc:2369] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:31:46.420401 21119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.415586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50570 (local address 127.13.149.67:40167)
0806 20:31:46.415771 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.415775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.415793 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:31:46.415883 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.415886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.415969 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.416095 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:31:46.416418 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.417240 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.418512 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.418909 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.419008 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.419462 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:31:46.419966 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:31:46.420087 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.420145 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.420205 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 20:31:46.428654 20824 raft_consensus.cc:1261] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 1 FOLLOWER]: Refusing update from remote peer 642843211c1e4e7cbd2f305b92404f13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:46.428648 20606 raft_consensus.cc:1261] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 1 FOLLOWER]: Refusing update from remote peer 642843211c1e4e7cbd2f305b92404f13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:46.429803 21141 consensus_queue.cc:1035] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fad8c6af4f4848a5dc944f1b90c389" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:46.430226 21134 consensus_queue.cc:1035] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eceba56e080f4637862501de0e6392f6" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:46.440647 21148 mvcc.cc:205] Tried to move back new op lower bound from 7315653863120846848 to 7315653862886342656. Current Snapshot: MvccSnapshot[applied={T|T < 7315653863120846848}]
I20260806 20:31:46.441283 21149 mvcc.cc:205] Tried to move back new op lower bound from 7315653863120846848 to 7315653862886342656. Current Snapshot: MvccSnapshot[applied={T|T < 7315653863120846848}]
I20260806 20:31:46.446332 21151 mvcc.cc:205] Tried to move back new op lower bound from 7315653863120846848 to 7315653862886342656. Current Snapshot: MvccSnapshot[applied={T|T < 7315653863120846848}]
I20260806 20:31:46.457190 20385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:46.457485 20385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:46.461169 20385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2598a7725069447ea138af4b11b36ef3: Sending DeleteTablet for 3 replicas of tablet ba83f724c76942d7a408efdefc316393
I20260806 20:31:46.462291 20999 tablet_service.cc:1514] Processing DeleteTablet for tablet ba83f724c76942d7a408efdefc316393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:46 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:50566
I20260806 20:31:46.462433 20789 tablet_service.cc:1514] Processing DeleteTablet for tablet ba83f724c76942d7a408efdefc316393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:46 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:44686
I20260806 20:31:46.462437 20578 tablet_service.cc:1514] Processing DeleteTablet for tablet ba83f724c76942d7a408efdefc316393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:46 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:44756
I20260806 20:31:46.463290 21165 tablet_replica.cc:330] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: stopping tablet replica
I20260806 20:31:46.463809 21165 raft_consensus.cc:2229] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:31:46.464677 21165 raft_consensus.cc:2258] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:46.464730 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 20475
I20260806 20:31:46.474458 21165 ts_tablet_manager.cc:1905] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:46.477847 21170 tablet_replica.cc:330] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: stopping tablet replica
I20260806 20:31:46.478422 21170 raft_consensus.cc:2229] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:46.479070 21170 raft_consensus.cc:2258] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:46.482869 21170 ts_tablet_manager.cc:1905] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:46.486615 21165 ts_tablet_manager.cc:1918] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:46.486860 21165 log.cc:1196] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/ba83f724c76942d7a408efdefc316393
I20260806 20:31:46.487509 21165 ts_tablet_manager.cc:1939] T ba83f724c76942d7a408efdefc316393 P 642843211c1e4e7cbd2f305b92404f13: Deleting consensus metadata
I20260806 20:31:46.489502 20369 catalog_manager.cc:4841] TS 642843211c1e4e7cbd2f305b92404f13 (127.13.149.67:40167): tablet ba83f724c76942d7a408efdefc316393 (table test-table [id=4f73c101afb04ae8a4fb77bb71ebf0e6]) successfully deleted
I20260806 20:31:46.491130 21166 tablet_replica.cc:330] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: stopping tablet replica
I20260806 20:31:46.491593 21166 raft_consensus.cc:2229] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:46.492154 21166 raft_consensus.cc:2258] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:46.494232 21166 ts_tablet_manager.cc:1905] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:46.494918 21170 ts_tablet_manager.cc:1918] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:46.495122 21170 log.cc:1196] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/ba83f724c76942d7a408efdefc316393
I20260806 20:31:46.495669 21170 ts_tablet_manager.cc:1939] T ba83f724c76942d7a408efdefc316393 P eceba56e080f4637862501de0e6392f6: Deleting consensus metadata
I20260806 20:31:46.497704 20366 catalog_manager.cc:4841] TS eceba56e080f4637862501de0e6392f6 (127.13.149.65:44897): tablet ba83f724c76942d7a408efdefc316393 (table test-table [id=4f73c101afb04ae8a4fb77bb71ebf0e6]) successfully deleted
I20260806 20:31:46.501223 21166 ts_tablet_manager.cc:1918] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:46.501392 21166 log.cc:1196] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/ba83f724c76942d7a408efdefc316393
I20260806 20:31:46.501880 21166 ts_tablet_manager.cc:1939] T ba83f724c76942d7a408efdefc316393 P 89fad8c6af4f4848a5dc944f1b90c389: Deleting consensus metadata
I20260806 20:31:46.503535 20369 catalog_manager.cc:4841] TS 89fad8c6af4f4848a5dc944f1b90c389 (127.13.149.66:45529): tablet ba83f724c76942d7a408efdefc316393 (table test-table [id=4f73c101afb04ae8a4fb77bb71ebf0e6]) successfully deleted
Aug 06 20:31:46 dist-test-slave-2kcd krb5kdc[20317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:46.512027 21121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.465892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44762 (local address 127.13.149.65:44897)
0806 20:31:46.466088 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.466095 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.480105 (+ 14010us) server_negotiation.cc:407] Connection header received
0806 20:31:46.480702 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.480709 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.480821 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.480900 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:46.490581 (+ 9681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.491687 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.493741 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.494408 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.494540 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.504962 (+ 10422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:46.504980 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:46.504998 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:46.505058 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:46.508860 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.509705 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.509714 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.509718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.509888 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.510310 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.510315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.510318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.510790 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:46.511135 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.511403 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.511635 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:31:46.512739 20667 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:46.621616 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 20475
I20260806 20:31:46.645263 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 20685
Aug 06 20:31:46 dist-test-slave-2kcd krb5kdc[20317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:46.662261 21122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.646096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44688 (local address 127.13.149.66:45529)
0806 20:31:46.646261 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.646266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.646284 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:31:46.646475 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.646479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.646539 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.646619 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:46.648291 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.649335 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.651155 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.651529 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.651618 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.656571 (+ 4953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:46.656598 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:46.656613 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:46.656647 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:46.659440 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.660114 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.660121 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.660124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.660255 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.660641 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.660646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.660650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.661091 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:46.661400 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.661695 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.661917 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 20:31:46.662957 20889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:46.775874 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 20685
I20260806 20:31:46.800979 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 20905
Aug 06 20:31:46 dist-test-slave-2kcd krb5kdc[20317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:46.818802 21119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:46.801908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.13.149.67:40167)
0806 20:31:46.802139 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:46.802153 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:46.802177 (+ 24us) server_negotiation.cc:407] Connection header received
0806 20:31:46.802246 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:46.802252 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:46.802346 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:46.802475 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:46.803749 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.805107 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.806308 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:46.807020 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:46.807179 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:46.811555 (+ 4376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:46.811576 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:46.811598 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:46.811646 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:46.815776 (+ 4130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.816418 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.816433 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.816437 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.816620 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:46.817106 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:46.817112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:46.817115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:46.817582 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:46.817958 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:46.818149 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 20:31:46.818383 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:31:46.819686 21094 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:46.940838 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 20905
I20260806 20:31:46.968252 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 20342
I20260806 20:31:46.969444 20431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:47.078902 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 20342
2026-08-06T20:31:47Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4562 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T20:31:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:47Z Disabled control of system clock
I20260806 20:31:47.162562 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:46445
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:46445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 20:31:47.509234 21184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:47.509562 21184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:47.509729 21184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:47.517382 21184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:47.517500 21184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:47.517578 21184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:47.517678 21184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:47.517758 21184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:47.527274 21184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:46445
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:46445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:47.528717 21184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:47.530596 21184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:47.542606 21200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:47.542560 21195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:47.542657 21196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:47.543704 21184 server_base.cc:1034] running on GCE node
I20260806 20:31:47.544534 21184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:47.546178 21184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:47.547396 21184 hybrid_clock.cc:648] HybridClock initialized: now 1786048307547339 us; error 53 us; skew 500 ppm
I20260806 20:31:47.547785 21184 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:47.550236 21184 webserver.cc:460] Webserver started at http://127.13.149.126:44521/ using document root <none> and password file <none>
I20260806 20:31:47.550987 21184 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:47.551143 21184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:47.551507 21184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:47.554648 21184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "d4879aea18284423bbb6c6bfe7e8df73"
format_stamp: "Formatted at 2026-08-06 20:31:47 on dist-test-slave-2kcd"
server_key: "e2aa1567d3725928b95eb011de2acc25"
server_key_iv: "1afcf763bfe724b82743a8e370d86477"
server_key_version: "encryptionkey@0"
I20260806 20:31:47.555500 21184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "d4879aea18284423bbb6c6bfe7e8df73"
format_stamp: "Formatted at 2026-08-06 20:31:47 on dist-test-slave-2kcd"
server_key: "e2aa1567d3725928b95eb011de2acc25"
server_key_iv: "1afcf763bfe724b82743a8e370d86477"
server_key_version: "encryptionkey@0"
I20260806 20:31:47.561012 21184 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:31:47.564564 21211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:47.566380 21184 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:47.566571 21184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "d4879aea18284423bbb6c6bfe7e8df73"
format_stamp: "Formatted at 2026-08-06 20:31:47 on dist-test-slave-2kcd"
server_key: "e2aa1567d3725928b95eb011de2acc25"
server_key_iv: "1afcf763bfe724b82743a8e370d86477"
server_key_version: "encryptionkey@0"
I20260806 20:31:47.566800 21184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:47.572556 21184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:47.573376 21184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:47.573709 21184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:47.592229 21184 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:46445
I20260806 20:31:47.592262 21282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:46445 every 8 connection(s)
I20260806 20:31:47.593585 21184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:47.594410 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 21184
I20260806 20:31:47.594630 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:47.595387 13909 external_mini_cluster.cc:1428] Setting key c8803f4df958730293749a3bf400e60f
I20260806 20:31:47.598121 21283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:47.603643 21290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:47.597448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56616 (local address 127.13.149.126:46445)
0806 20:31:47.598477 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:47.598488 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:47.598536 (+ 48us) server_negotiation.cc:407] Connection header received
0806 20:31:47.600091 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:47.600111 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:47.600487 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:47.600908 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:47.601991 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:47.601997 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:47.602011 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:47.602024 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:47.602101 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:47.602117 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:47.602371 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:47.602555 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 20:31:47.602782 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":359,"threads_started":1}
I20260806 20:31:47.609445 21283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73: Bootstrap starting.
I20260806 20:31:47.612452 21283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:47.613523 21283 log.cc:824] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:47.616004 21283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73: No bootstrap required, opened a new log
I20260806 20:31:47.623138 21283 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4879aea18284423bbb6c6bfe7e8df73" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46445 } }
I20260806 20:31:47.623524 21283 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:47.623631 21283 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4879aea18284423bbb6c6bfe7e8df73, State: Initialized, Role: FOLLOWER
I20260806 20:31:47.624145 21283 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4879aea18284423bbb6c6bfe7e8df73" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46445 } }
I20260806 20:31:47.624387 21283 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:47.624547 21283 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:47.624737 21283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:47.626993 21283 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4879aea18284423bbb6c6bfe7e8df73" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46445 } }
I20260806 20:31:47.627462 21283 leader_election.cc:302] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4879aea18284423bbb6c6bfe7e8df73; no voters:
I20260806 20:31:47.628024 21283 leader_election.cc:288] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:47.628183 21292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:47.629015 21292 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [term 1 LEADER]: Becoming Leader. State: Replica: d4879aea18284423bbb6c6bfe7e8df73, State: Running, Role: LEADER
I20260806 20:31:47.629488 21292 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4879aea18284423bbb6c6bfe7e8df73" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46445 } }
I20260806 20:31:47.630110 21283 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:47.632483 21297 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4879aea18284423bbb6c6bfe7e8df73. Latest consensus state: current_term: 1 leader_uuid: "d4879aea18284423bbb6c6bfe7e8df73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4879aea18284423bbb6c6bfe7e8df73" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46445 } } }
I20260806 20:31:47.632972 21297 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:47.632490 21296 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4879aea18284423bbb6c6bfe7e8df73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4879aea18284423bbb6c6bfe7e8df73" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46445 } } }
I20260806 20:31:47.633543 21296 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:47.635845 21306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:47.640935 21306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:47.649816 21306 catalog_manager.cc:1347] Generated new cluster ID: a0727db205a3458b81ec123c59481c7a
I20260806 20:31:47.649930 21306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:47.678300 21306 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:47.678717 21306 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:47.689292 21306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73: Generated new TSK 0
I20260806 20:31:47.690114 21306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:31:47.703107 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46445
--builtin_ntp_servers=127.13.149.84:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 20:31:48.064646 21323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:48.065006 21323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:48.065181 21323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:48.072768 21323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:48.072950 21323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:48.073184 21323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:48.082607 21323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:48.083997 21323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:48.085881 21323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:48.099126 21334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:48.099210 21332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:48.099383 21331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:48.100060 21323 server_base.cc:1034] running on GCE node
I20260806 20:31:48.100649 21323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:48.101605 21323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:48.102833 21323 hybrid_clock.cc:648] HybridClock initialized: now 1786048308102783 us; error 45 us; skew 500 ppm
I20260806 20:31:48.103144 21323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:48.105578 21323 webserver.cc:460] Webserver started at http://127.13.149.65:35475/ using document root <none> and password file <none>
I20260806 20:31:48.106278 21323 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:48.106416 21323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:48.106765 21323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:48.109750 21323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "ea7bab9ffa0b492a891e49e73b9f84bc"
format_stamp: "Formatted at 2026-08-06 20:31:48 on dist-test-slave-2kcd"
server_key: "73279f2a95f1a492f052afd5c919ed86"
server_key_iv: "b8e79433a8edd053a135da8e6d26e9f4"
server_key_version: "encryptionkey@0"
I20260806 20:31:48.110574 21323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "ea7bab9ffa0b492a891e49e73b9f84bc"
format_stamp: "Formatted at 2026-08-06 20:31:48 on dist-test-slave-2kcd"
server_key: "73279f2a95f1a492f052afd5c919ed86"
server_key_iv: "b8e79433a8edd053a135da8e6d26e9f4"
server_key_version: "encryptionkey@0"
I20260806 20:31:48.115911 21323 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260806 20:31:48.119596 21343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:48.121114 21323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 20:31:48.121308 21323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "ea7bab9ffa0b492a891e49e73b9f84bc"
format_stamp: "Formatted at 2026-08-06 20:31:48 on dist-test-slave-2kcd"
server_key: "73279f2a95f1a492f052afd5c919ed86"
server_key_iv: "b8e79433a8edd053a135da8e6d26e9f4"
server_key_version: "encryptionkey@0"
I20260806 20:31:48.121551 21323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:48.127457 21323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:48.128291 21323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:48.128602 21323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:48.129694 21323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:48.131242 21323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:48.131367 21323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:48.131511 21323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:48.131604 21323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:48.167367 21323 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:43013
I20260806 20:31:48.167421 21527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:43013 every 8 connection(s)
I20260806 20:31:48.168771 21323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:48.170894 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 21323
I20260806 20:31:48.171166 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:48.171923 13909 external_mini_cluster.cc:1428] Setting key 590db500bfdb8eb8da7885ffe333c7ac
I20260806 20:31:48.175048 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46445
--builtin_ntp_servers=127.13.149.84:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 20:31:48.178073 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:48.171837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:44711 (local address 127.13.149.126:46445)
0806 20:31:48.172412 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:48.172420 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:48.173796 (+ 1376us) server_negotiation.cc:407] Connection header received
0806 20:31:48.175669 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:48.175674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:48.175738 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:48.175879 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:48.177248 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:48.177253 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:48.177258 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:48.177276 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:48.177328 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:48.177342 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:48.177473 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:48.177672 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 20:31:48.177743 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":276,"threads_started":1}
I20260806 20:31:48.178977 21533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:48.172528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46445 (local address 127.13.149.65:44711)
0806 20:31:48.173649 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:48.173686 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:48.175409 (+ 1723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:48.176115 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:48.176123 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:48.176213 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:48.176958 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:48.176960 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:48.176998 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:48.177083 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:48.177451 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:48.177462 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:48.177470 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 20:31:48.177756 (+ 286us) client_negotiation.cc:240] Negotiation successful
0806 20:31:48.178002 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":388,"threads_started":1}
I20260806 20:31:48.180558 21528 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46445
I20260806 20:31:48.180898 21528 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:48.181489 21528 heartbeater.cc:511] Master 127.13.149.126:46445 requested a full tablet report, sending...
I20260806 20:31:48.183720 21231 ts_manager.cc:194] Registered new tserver with Master: ea7bab9ffa0b492a891e49e73b9f84bc (127.13.149.65:43013)
W20260806 20:31:48.518116 21534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:48.518415 21534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:48.518507 21534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:48.526003 21534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:48.526108 21534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:48.526302 21534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:48.535806 21534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:48.537298 21534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:48.539215 21534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:48.553632 21546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:48.553678 21545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:48.553723 21549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:48.554484 21534 server_base.cc:1034] running on GCE node
I20260806 20:31:48.555047 21534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:48.556002 21534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:48.557201 21534 hybrid_clock.cc:648] HybridClock initialized: now 1786048308557157 us; error 33 us; skew 500 ppm
I20260806 20:31:48.557549 21534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:48.559955 21534 webserver.cc:460] Webserver started at http://127.13.149.66:36701/ using document root <none> and password file <none>
I20260806 20:31:48.560699 21534 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:48.560835 21534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:48.561203 21534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:48.564179 21534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "bba4ff8fdb32420b93f8e4e1704f1540"
format_stamp: "Formatted at 2026-08-06 20:31:48 on dist-test-slave-2kcd"
server_key: "04a5fa8f0c132b302047bf8a92367b97"
server_key_iv: "f98b8d7cb56f1136e332b389518c10b4"
server_key_version: "encryptionkey@0"
I20260806 20:31:48.565083 21534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "bba4ff8fdb32420b93f8e4e1704f1540"
format_stamp: "Formatted at 2026-08-06 20:31:48 on dist-test-slave-2kcd"
server_key: "04a5fa8f0c132b302047bf8a92367b97"
server_key_iv: "f98b8d7cb56f1136e332b389518c10b4"
server_key_version: "encryptionkey@0"
I20260806 20:31:48.570405 21534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:31:48.574069 21561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:48.575414 21534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:31:48.575611 21534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "bba4ff8fdb32420b93f8e4e1704f1540"
format_stamp: "Formatted at 2026-08-06 20:31:48 on dist-test-slave-2kcd"
server_key: "04a5fa8f0c132b302047bf8a92367b97"
server_key_iv: "f98b8d7cb56f1136e332b389518c10b4"
server_key_version: "encryptionkey@0"
I20260806 20:31:48.575836 21534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:48.581772 21534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:48.582607 21534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:48.582894 21534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:48.583881 21534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:48.585387 21534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:48.585511 21534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:48.585656 21534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:48.585752 21534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:48.625034 21534 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:34879
I20260806 20:31:48.625084 21739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:34879 every 8 connection(s)
I20260806 20:31:48.626459 21534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:48.632426 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 21534
I20260806 20:31:48.632594 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:48.633206 13909 external_mini_cluster.cc:1428] Setting key 2e8fd0a52639011a0a6d95a0b81c51bd
I20260806 20:31:48.635217 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:48.629049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:53623 (local address 127.13.149.126:46445)
0806 20:31:48.629229 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:48.629234 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:48.630786 (+ 1552us) server_negotiation.cc:407] Connection header received
0806 20:31:48.632705 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:48.632711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:48.632808 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:48.632924 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:48.634365 (+ 1441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:48.634371 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:48.634376 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:48.634395 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:48.634444 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:48.634469 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:48.634575 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:48.634846 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 20:31:48.634903 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:31:48.636387 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:48.629594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46445 (local address 127.13.149.66:53623)
0806 20:31:48.630591 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:48.630665 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:48.632310 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:48.633120 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:48.633128 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:48.633213 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:48.634020 (+ 807us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:48.634025 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:48.634081 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:48.634190 (+ 109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:48.634589 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:48.634601 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:48.634608 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 20:31:48.634901 (+ 293us) client_negotiation.cc:240] Negotiation successful
0806 20:31:48.635213 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":329,"threads_started":1}
I20260806 20:31:48.636741 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46445
--builtin_ntp_servers=127.13.149.84:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 20:31:48.637775 21741 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46445
I20260806 20:31:48.638089 21741 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:48.638656 21741 heartbeater.cc:511] Master 127.13.149.126:46445 requested a full tablet report, sending...
I20260806 20:31:48.640027 21231 ts_manager.cc:194] Registered new tserver with Master: bba4ff8fdb32420b93f8e4e1704f1540 (127.13.149.66:34879)
W20260806 20:31:48.975835 21749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:48.976145 21749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:48.976254 21749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:48.983790 21749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:48.983907 21749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:48.984027 21749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:48.993458 21749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:48.994748 21749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:48.996678 21749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:49.010391 21756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:49.010422 21757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:49.010586 21760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:49.011232 21749 server_base.cc:1034] running on GCE node
I20260806 20:31:49.011826 21749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:49.012753 21749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:49.014045 21749 hybrid_clock.cc:648] HybridClock initialized: now 1786048309013989 us; error 56 us; skew 500 ppm
I20260806 20:31:49.014421 21749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:49.017010 21749 webserver.cc:460] Webserver started at http://127.13.149.67:36463/ using document root <none> and password file <none>
I20260806 20:31:49.017743 21749 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:49.017895 21749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:49.018267 21749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:49.021323 21749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "56715206a3544419a8e0edfee3f3c930"
format_stamp: "Formatted at 2026-08-06 20:31:49 on dist-test-slave-2kcd"
server_key: "c1c08b9e6237352e65671a9ef54bd7eb"
server_key_iv: "c622afc879cd932ea900c1b9d41c98d4"
server_key_version: "encryptionkey@0"
I20260806 20:31:49.022185 21749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "56715206a3544419a8e0edfee3f3c930"
format_stamp: "Formatted at 2026-08-06 20:31:49 on dist-test-slave-2kcd"
server_key: "c1c08b9e6237352e65671a9ef54bd7eb"
server_key_iv: "c622afc879cd932ea900c1b9d41c98d4"
server_key_version: "encryptionkey@0"
I20260806 20:31:49.027732 21749 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 20:31:49.031486 21770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:49.032964 21749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:49.033157 21749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "56715206a3544419a8e0edfee3f3c930"
format_stamp: "Formatted at 2026-08-06 20:31:49 on dist-test-slave-2kcd"
server_key: "c1c08b9e6237352e65671a9ef54bd7eb"
server_key_iv: "c622afc879cd932ea900c1b9d41c98d4"
server_key_version: "encryptionkey@0"
I20260806 20:31:49.033411 21749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:49.039428 21749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:49.040278 21749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:49.040596 21749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:49.041658 21749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:49.043164 21749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:49.043301 21749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:49.043473 21749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:49.043581 21749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:49.079353 21749 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:42117
I20260806 20:31:49.079376 21928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:42117 every 8 connection(s)
I20260806 20:31:49.080969 21749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:49.089335 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.083747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:34815 (local address 127.13.149.126:46445)
0806 20:31:49.083922 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.083926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.085400 (+ 1474us) server_negotiation.cc:407] Connection header received
0806 20:31:49.087049 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.087055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.087130 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.087242 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.088529 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.088533 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.088536 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.088552 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.088593 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.088604 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.088728 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.088963 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.089039 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:31:49.090267 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.084251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46445 (local address 127.13.149.67:34815)
0806 20:31:49.085235 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.085271 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:49.086784 (+ 1513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:49.087483 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:49.087491 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:49.087575 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:49.088224 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:49.088227 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:49.088262 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:49.088340 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:49.088713 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:49.088724 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:49.088731 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 20:31:49.089048 (+ 317us) client_negotiation.cc:240] Negotiation successful
0806 20:31:49.089281 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":288,"threads_started":1}
I20260806 20:31:49.091182 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 21749
I20260806 20:31:49.091356 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:49.091642 21931 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46445
I20260806 20:31:49.091861 13909 external_mini_cluster.cc:1428] Setting key ebeaa1b4481d1f044f4d30b4df61fdc1
I20260806 20:31:49.091921 21931 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:49.092665 21931 heartbeater.cc:511] Master 127.13.149.126:46445 requested a full tablet report, sending...
I20260806 20:31:49.094388 21231 ts_manager.cc:194] Registered new tserver with Master: 56715206a3544419a8e0edfee3f3c930 (127.13.149.67:42117)
I20260806 20:31:49.107295 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:31:49.115393 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.112423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56630 (local address 127.13.149.126:46445)
0806 20:31:49.112647 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.112653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.113301 (+ 648us) server_negotiation.cc:407] Connection header received
0806 20:31:49.113517 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.113523 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.113593 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.113700 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.114729 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.114735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.114739 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.114757 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.114801 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.114813 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.114943 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.115047 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.115111 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 20:31:49.119406 21231 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56630:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:31:49.126435 21231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:31:49.156284 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.139240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52466 (local address 127.13.149.65:43013)
0806 20:31:49.151381 (+ 12141us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.151392 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.151677 (+ 285us) server_negotiation.cc:407] Connection header received
0806 20:31:49.151955 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.151979 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.152301 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.152476 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.155337 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.155347 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.155363 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.155391 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.155457 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.155484 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.155618 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.155748 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.155852 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11975,"thread_start_us":11851,"threads_started":1}
I20260806 20:31:49.156627 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.139575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54970 (local address 127.13.149.67:42117)
0806 20:31:49.150759 (+ 11184us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.150773 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.152636 (+ 1863us) server_negotiation.cc:407] Connection header received
0806 20:31:49.153122 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.153131 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.153343 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.153488 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.155569 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.155579 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.155591 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.155611 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.155670 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.155693 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.155871 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.156111 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.156235 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10953,"thread_start_us":11191,"threads_started":1}
I20260806 20:31:49.156641 21961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.141679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:34879 (local address 127.0.0.1:49408)
0806 20:31:49.153639 (+ 11960us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.153656 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:49.153753 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:49.154393 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:49.154399 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:49.154423 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:49.155381 (+ 958us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:49.155383 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:49.155395 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:49.155425 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:49.155915 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:49.155921 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:49.155926 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 20:31:49.156080 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 20:31:49.156139 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11829,"thread_start_us":12189,"threads_started":1}
I20260806 20:31:49.156642 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.139119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52466)
0806 20:31:49.151466 (+ 12347us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.151532 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:49.151731 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:49.153642 (+ 1911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:49.153653 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:49.153749 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:49.154980 (+ 1231us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:49.154984 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:49.155018 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:49.155113 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:49.155568 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:49.155580 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:49.155587 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 20:31:49.155758 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 20:31:49.155850 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11995,"thread_start_us":12759,"threads_started":1}
I20260806 20:31:49.157310 21964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.142353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49408 (local address 127.13.149.66:34879)
0806 20:31:49.153222 (+ 10869us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.153230 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.153885 (+ 655us) server_negotiation.cc:407] Connection header received
0806 20:31:49.153991 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.154000 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.154207 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.154371 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.155621 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.155628 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.155638 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.155656 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.155709 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.155731 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.155853 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.156735 (+ 882us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.156944 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10712,"thread_start_us":11683,"threads_started":1}
I20260806 20:31:49.157509 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.139225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:42117 (local address 127.0.0.1:54970)
0806 20:31:49.152519 (+ 13294us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.152537 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:49.152930 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:49.154642 (+ 1712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:49.154647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:49.154673 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:49.155323 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:49.155327 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:49.155346 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:49.155390 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:49.155918 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:49.155922 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:49.155926 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 20:31:49.156923 (+ 997us) client_negotiation.cc:240] Negotiation successful
0806 20:31:49.156970 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13137,"thread_start_us":13439,"threads_started":1}
I20260806 20:31:49.161262 21640 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae3bf61c10b40c0858e563975177f2e (DEFAULT_TABLE table=test-table [id=91b7918ec0d64748bc77112ef76cb613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:49.161285 21425 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae3bf61c10b40c0858e563975177f2e (DEFAULT_TABLE table=test-table [id=91b7918ec0d64748bc77112ef76cb613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:49.161285 21835 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae3bf61c10b40c0858e563975177f2e (DEFAULT_TABLE table=test-table [id=91b7918ec0d64748bc77112ef76cb613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:31:49.162531 21640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae3bf61c10b40c0858e563975177f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:49.162655 21425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae3bf61c10b40c0858e563975177f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:49.162652 21835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae3bf61c10b40c0858e563975177f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:49.180420 21966 tablet_bootstrap.cc:492] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Bootstrap starting.
I20260806 20:31:49.183748 21965 tablet_bootstrap.cc:492] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Bootstrap starting.
I20260806 20:31:49.186475 21966 tablet_bootstrap.cc:654] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:49.186749 21528 heartbeater.cc:503] Master 127.13.149.126:46445 was elected leader, sending a full tablet report...
I20260806 20:31:49.187376 21967 tablet_bootstrap.cc:492] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc: Bootstrap starting.
I20260806 20:31:49.187858 21966 log.cc:824] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:49.189138 21965 tablet_bootstrap.cc:654] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:49.190433 21965 log.cc:824] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:49.191553 21966 tablet_bootstrap.cc:492] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: No bootstrap required, opened a new log
I20260806 20:31:49.191968 21966 ts_tablet_manager.cc:1397] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260806 20:31:49.193544 21967 tablet_bootstrap.cc:654] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:49.194792 21967 log.cc:824] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:49.196404 21965 tablet_bootstrap.cc:492] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: No bootstrap required, opened a new log
I20260806 20:31:49.196686 21965 ts_tablet_manager.cc:1397] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260806 20:31:49.197330 21967 tablet_bootstrap.cc:492] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc: No bootstrap required, opened a new log
I20260806 20:31:49.197579 21967 ts_tablet_manager.cc:1397] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 20:31:49.202543 21966 raft_consensus.cc:348] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.202992 21966 raft_consensus.cc:374] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:49.203104 21966 raft_consensus.cc:729] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56715206a3544419a8e0edfee3f3c930, State: Initialized, Role: FOLLOWER
I20260806 20:31:49.203742 21966 consensus_queue.cc:260] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.204706 21967 raft_consensus.cc:348] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.205848 21931 heartbeater.cc:503] Master 127.13.149.126:46445 was elected leader, sending a full tablet report...
I20260806 20:31:49.205977 21967 raft_consensus.cc:374] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:49.206068 21967 raft_consensus.cc:729] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea7bab9ffa0b492a891e49e73b9f84bc, State: Initialized, Role: FOLLOWER
I20260806 20:31:49.206524 21966 ts_tablet_manager.cc:1428] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
I20260806 20:31:49.206708 21967 consensus_queue.cc:260] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.207228 21965 raft_consensus.cc:348] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.207665 21965 raft_consensus.cc:374] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:49.207772 21965 raft_consensus.cc:729] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bba4ff8fdb32420b93f8e4e1704f1540, State: Initialized, Role: FOLLOWER
I20260806 20:31:49.208328 21965 consensus_queue.cc:260] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.208680 21967 ts_tablet_manager.cc:1428] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260806 20:31:49.209574 21741 heartbeater.cc:503] Master 127.13.149.126:46445 was elected leader, sending a full tablet report...
I20260806 20:31:49.210137 21965 ts_tablet_manager.cc:1428] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Time spent starting tablet: real 0.013s user 0.011s sys 0.004s
I20260806 20:31:49.223949 21974 raft_consensus.cc:482] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:31:49.224172 21974 raft_consensus.cc:504] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.225723 21974 leader_election.cc:288] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56715206a3544419a8e0edfee3f3c930 (127.13.149.67:42117), bba4ff8fdb32420b93f8e4e1704f1540 (127.13.149.66:34879)
I20260806 20:31:49.228942 21964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.226230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:44209 (local address 127.13.149.66:34879)
0806 20:31:49.226633 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.226641 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.226942 (+ 301us) server_negotiation.cc:407] Connection header received
0806 20:31:49.227113 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.227119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.227176 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.227273 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.228279 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.228285 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.228290 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.228313 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.228341 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.228352 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.228470 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.228579 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.228644 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272}
I20260806 20:31:49.229148 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.226091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:50971 (local address 127.13.149.67:42117)
0806 20:31:49.226476 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.226482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.227145 (+ 663us) server_negotiation.cc:407] Connection header received
0806 20:31:49.227286 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.227291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.227343 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.227451 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.228476 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.228513 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.228517 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.228538 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.228585 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.228597 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.228724 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.228833 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.228897 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219}
I20260806 20:31:49.229396 21978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.225989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:34879 (local address 127.13.149.65:44209)
0806 20:31:49.226819 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.226842 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:49.226970 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:49.227308 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:49.227313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:49.227337 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:49.228088 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:49.228090 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:49.228103 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:49.228141 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:49.228446 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:49.228462 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:49.228466 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 20:31:49.228614 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 20:31:49.228664 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":415,"threads_started":1}
I20260806 20:31:49.229422 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.226104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:42117 (local address 127.13.149.65:50971)
0806 20:31:49.227022 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.227057 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:49.227164 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:49.227487 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:49.227493 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:49.227511 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:49.228270 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:31:49.228272 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:49.228285 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:31:49.228320 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:49.228698 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:49.228706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:49.228711 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 20:31:49.228906 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 20:31:49.228968 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":591,"threads_started":1}
I20260806 20:31:49.230465 21670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae3bf61c10b40c0858e563975177f2e" candidate_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" is_pre_election: true
I20260806 20:31:49.230518 21865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae3bf61c10b40c0858e563975177f2e" candidate_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56715206a3544419a8e0edfee3f3c930" is_pre_election: true
I20260806 20:31:49.230930 21670 raft_consensus.cc:2454] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea7bab9ffa0b492a891e49e73b9f84bc in term 0.
I20260806 20:31:49.230973 21865 raft_consensus.cc:2454] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea7bab9ffa0b492a891e49e73b9f84bc in term 0.
I20260806 20:31:49.231662 21349 leader_election.cc:302] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bba4ff8fdb32420b93f8e4e1704f1540, ea7bab9ffa0b492a891e49e73b9f84bc; no voters:
I20260806 20:31:49.232021 21974 raft_consensus.cc:2781] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:31:49.232170 21974 raft_consensus.cc:482] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:31:49.232295 21974 raft_consensus.cc:3037] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:49.234511 21974 raft_consensus.cc:504] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.235116 21974 leader_election.cc:288] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [CANDIDATE]: Term 1 election: Requested vote from peers 56715206a3544419a8e0edfee3f3c930 (127.13.149.67:42117), bba4ff8fdb32420b93f8e4e1704f1540 (127.13.149.66:34879)
I20260806 20:31:49.235455 21865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae3bf61c10b40c0858e563975177f2e" candidate_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56715206a3544419a8e0edfee3f3c930"
I20260806 20:31:49.235615 21670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae3bf61c10b40c0858e563975177f2e" candidate_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bba4ff8fdb32420b93f8e4e1704f1540"
I20260806 20:31:49.235657 21865 raft_consensus.cc:3037] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:49.235814 21670 raft_consensus.cc:3037] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:49.239038 21670 raft_consensus.cc:2454] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea7bab9ffa0b492a891e49e73b9f84bc in term 1.
I20260806 20:31:49.239040 21865 raft_consensus.cc:2454] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea7bab9ffa0b492a891e49e73b9f84bc in term 1.
I20260806 20:31:49.239427 21349 leader_election.cc:302] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bba4ff8fdb32420b93f8e4e1704f1540, ea7bab9ffa0b492a891e49e73b9f84bc; no voters:
I20260806 20:31:49.239692 21974 raft_consensus.cc:2781] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:49.240161 21974 raft_consensus.cc:686] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [term 1 LEADER]: Becoming Leader. State: Replica: ea7bab9ffa0b492a891e49e73b9f84bc, State: Running, Role: LEADER
I20260806 20:31:49.240700 21974 consensus_queue.cc:237] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } }
I20260806 20:31:49.245343 21229 catalog_manager.cc:5495] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc reported cstate change: term changed from 0 to 1, leader changed from <none> to ea7bab9ffa0b492a891e49e73b9f84bc (127.13.149.65). New cstate: current_term: 1 leader_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea7bab9ffa0b492a891e49e73b9f84bc" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 43013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260806 20:31:49.274111 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.272015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52472 (local address 127.13.149.65:43013)
0806 20:31:49.272188 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.272192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.272334 (+ 142us) server_negotiation.cc:407] Connection header received
0806 20:31:49.272513 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.272517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.272598 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.272691 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.273593 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.273597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.273600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.273612 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.273639 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.273650 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.273738 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.273835 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.273882 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 20:31:49.282331 21865 raft_consensus.cc:1261] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 1 FOLLOWER]: Refusing update from remote peer ea7bab9ffa0b492a891e49e73b9f84bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:49.282331 21670 raft_consensus.cc:1261] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 1 FOLLOWER]: Refusing update from remote peer ea7bab9ffa0b492a891e49e73b9f84bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:31:49.283390 21974 consensus_queue.cc:1035] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "56715206a3544419a8e0edfee3f3c930" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:49.283703 21980 consensus_queue.cc:1035] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bba4ff8fdb32420b93f8e4e1704f1540" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:31:49.294941 21986 mvcc.cc:205] Tried to move back new op lower bound from 7315653874810376192 to 7315653874653765632. Current Snapshot: MvccSnapshot[applied={T|T < 7315653874810376192}]
I20260806 20:31:49.307767 21230 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56630:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:49.308109 21230 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56630:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:31:49.308121 21988 mvcc.cc:205] Tried to move back new op lower bound from 7315653874810376192 to 7315653874653765632. Current Snapshot: MvccSnapshot[applied={T|T < 7315653874810376192}]
I20260806 20:31:49.312845 21230 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4879aea18284423bbb6c6bfe7e8df73: Sending DeleteTablet for 3 replicas of tablet 8ae3bf61c10b40c0858e563975177f2e
I20260806 20:31:49.313931 21425 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ae3bf61c10b40c0858e563975177f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:49 UTC) from {username='slave'} at 127.0.0.1:52466
I20260806 20:31:49.314105 21835 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ae3bf61c10b40c0858e563975177f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:49 UTC) from {username='slave'} at 127.0.0.1:54970
I20260806 20:31:49.315032 21834 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ae3bf61c10b40c0858e563975177f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:49 UTC) from {username='slave'} at 127.0.0.1:54970
I20260806 20:31:49.316102 21640 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ae3bf61c10b40c0858e563975177f2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:31:49 UTC) from {username='slave'} at 127.0.0.1:49408
I20260806 20:31:49.318791 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 21323
I20260806 20:31:49.324717 22003 tablet_replica.cc:330] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: stopping tablet replica
I20260806 20:31:49.326493 22003 raft_consensus.cc:2229] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:49.327158 22003 raft_consensus.cc:2258] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:49.327781 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.320757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52478 (local address 127.13.149.65:43013)
0806 20:31:49.320995 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.321004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.324918 (+ 3914us) server_negotiation.cc:407] Connection header received
0806 20:31:49.325275 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.325281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.325346 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.325424 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.326881 (+ 1457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.326886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.326892 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.326913 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.326958 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.326974 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.327084 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.327407 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.327478 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 20:31:49.329257 21523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:49.329658 22002 tablet_replica.cc:330] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: stopping tablet replica
I20260806 20:31:49.330291 22002 raft_consensus.cc:2229] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:31:49.330976 22002 raft_consensus.cc:2258] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:31:49.332418 22003 ts_tablet_manager.cc:1905] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:49.333356 22002 ts_tablet_manager.cc:1905] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:31:49.338661 22003 ts_tablet_manager.cc:1918] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:49.338842 22003 log.cc:1196] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/8ae3bf61c10b40c0858e563975177f2e
I20260806 20:31:49.339315 22003 ts_tablet_manager.cc:1939] T 8ae3bf61c10b40c0858e563975177f2e P bba4ff8fdb32420b93f8e4e1704f1540: Deleting consensus metadata
I20260806 20:31:49.340693 22002 ts_tablet_manager.cc:1918] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:31:49.340876 22002 log.cc:1196] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/8ae3bf61c10b40c0858e563975177f2e
I20260806 20:31:49.340996 21216 catalog_manager.cc:4841] TS bba4ff8fdb32420b93f8e4e1704f1540 (127.13.149.66:34879): tablet 8ae3bf61c10b40c0858e563975177f2e (table test-table [id=91b7918ec0d64748bc77112ef76cb613]) successfully deleted
I20260806 20:31:49.341435 22002 ts_tablet_manager.cc:1939] T 8ae3bf61c10b40c0858e563975177f2e P 56715206a3544419a8e0edfee3f3c930: Deleting consensus metadata
I20260806 20:31:49.343312 21214 catalog_manager.cc:4841] TS 56715206a3544419a8e0edfee3f3c930 (127.13.149.67:42117): tablet 8ae3bf61c10b40c0858e563975177f2e (table test-table [id=91b7918ec0d64748bc77112ef76cb613]) successfully deleted
W20260806 20:31:49.343822 21214 catalog_manager.cc:4808] TS 56715206a3544419a8e0edfee3f3c930 (127.13.149.67:42117): delete failed for tablet 8ae3bf61c10b40c0858e563975177f2e because the tablet was not found. No further retry: Not found: Tablet not found: 8ae3bf61c10b40c0858e563975177f2e
I20260806 20:31:49.428678 22001 tablet_replica.cc:330] T 8ae3bf61c10b40c0858e563975177f2e P ea7bab9ffa0b492a891e49e73b9f84bc: stopping tablet replica
I20260806 20:31:49.428988 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 21323
I20260806 20:31:49.458456 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 21534
W20260806 20:31:49.458429 21212 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.149.65:43013 (error 108)
I20260806 20:31:49.460427 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.459918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52490)
0806 20:31:49.460165 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.460287 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260806 20:31:49.460659 21212 catalog_manager.cc:4584] TS ea7bab9ffa0b492a891e49e73b9f84bc (127.13.149.65:43013): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ae3bf61c10b40c0858e563975177f2e: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
I20260806 20:31:49.461783 21964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.459393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49412 (local address 127.13.149.66:34879)
0806 20:31:49.459599 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.459605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.459627 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:31:49.459758 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.459767 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.459873 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.459963 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.461239 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.461244 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.461247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.461262 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.461292 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.461304 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.461406 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.461518 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.461566 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:31:49.462407 21729 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:49.514720 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.514096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52504)
0806 20:31:49.514429 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.514548 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260806 20:31:49.515805 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.515452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52508)
0806 20:31:49.515606 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.515685 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 20:31:49.551450 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 21534
I20260806 20:31:49.576668 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 21749
I20260806 20:31:49.576771 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.576070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52520)
0806 20:31:49.576474 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.576574 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264}
I20260806 20:31:49.577980 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.577524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52526)
0806 20:31:49.577742 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.577831 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260806 20:31:49.579624 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.577531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54972 (local address 127.13.149.67:42117)
0806 20:31:49.577716 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:49.577722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:49.577744 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:31:49.577852 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:49.577857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:49.577968 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:49.578102 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:49.579025 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:49.579029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:49.579032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:49.579048 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:49.579080 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:49.579091 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:49.579210 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:49.579348 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 20:31:49.579402 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:31:49.580260 21924 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:49.658888 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.658198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52534)
0806 20:31:49.658541 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.658689 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 20:31:49.660048 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:49.659658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:43013 (local address 127.0.0.1:52540)
0806 20:31:49.659864 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:49.659935 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:43013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260806 20:31:49.685217 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 21749
I20260806 20:31:49.711647 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 21184
I20260806 20:31:49.713028 21276 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:49.822191 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 21184
2026-08-06T20:31:49Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2742 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 20:31:49.873085 13909 mini_oidc.cc:152] Starting JWKS server
I20260806 20:31:49.877555 13909 webserver.cc:460] Webserver started at https://127.0.0.1:36921/ using document root <none> and password file <none>
I20260806 20:31:49.877929 13909 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 20:31:49.878592 13909 webserver.cc:460] Webserver started at http://127.0.0.1:34383/ using document root <none> and password file <none>
2026-08-06T20:31:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:49Z Disabled control of system clock
I20260806 20:31:49.911402 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44159
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:44159
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36921/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/testchainca.cert with env {}
W20260806 20:31:50.239848 22019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:50.240178 22019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:50.240352 22019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:50.247429 22019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:50.247582 22019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:50.247668 22019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:50.247776 22019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:50.247860 22019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 20:31:50.247951 22019 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 20:31:50.248047 22019 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36921/jwks.json
I20260806 20:31:50.261577 22019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:44159
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36921/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:50.262892 22019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:50.264222 22019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:50.276113 22035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:50.276196 22033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:50.276443 22029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:50.277097 22019 server_base.cc:1034] running on GCE node
I20260806 20:31:50.277827 22019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:50.279223 22019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:50.280431 22019 hybrid_clock.cc:648] HybridClock initialized: now 1786048310280391 us; error 35 us; skew 500 ppm
I20260806 20:31:50.280750 22019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:50.283041 22019 webserver.cc:460] Webserver started at http://127.13.149.126:43635/ using document root <none> and password file <none>
I20260806 20:31:50.283735 22019 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:50.283830 22019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:50.284181 22019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:50.287211 22019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "da5eb61f6ffa43f4aaa7c521743dedc8"
format_stamp: "Formatted at 2026-08-06 20:31:50 on dist-test-slave-2kcd"
server_key: "202322986686e5ce634148cca32c0562"
server_key_iv: "a169a85ab0a3c763d0828f857e20df76"
server_key_version: "encryptionkey@0"
I20260806 20:31:50.288043 22019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "da5eb61f6ffa43f4aaa7c521743dedc8"
format_stamp: "Formatted at 2026-08-06 20:31:50 on dist-test-slave-2kcd"
server_key: "202322986686e5ce634148cca32c0562"
server_key_iv: "a169a85ab0a3c763d0828f857e20df76"
server_key_version: "encryptionkey@0"
I20260806 20:31:50.293272 22019 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 20:31:50.296854 22043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:50.298228 22019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:31:50.298432 22019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "da5eb61f6ffa43f4aaa7c521743dedc8"
format_stamp: "Formatted at 2026-08-06 20:31:50 on dist-test-slave-2kcd"
server_key: "202322986686e5ce634148cca32c0562"
server_key_iv: "a169a85ab0a3c763d0828f857e20df76"
server_key_version: "encryptionkey@0"
I20260806 20:31:50.298671 22019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:50.317365 22019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:50.318286 22019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:50.318627 22019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:50.338038 22019 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:44159
I20260806 20:31:50.338050 22128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:44159 every 8 connection(s)
I20260806 20:31:50.339490 22019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:50.339879 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 22019
I20260806 20:31:50.340129 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:50.341028 13909 external_mini_cluster.cc:1428] Setting key 0a0908b24caccfe4496b62e689062f48
I20260806 20:31:50.344208 22130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:50.357216 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:50.343093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50978 (local address 127.13.149.126:44159)
0806 20:31:50.344183 (+ 1090us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:50.344205 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:50.344259 (+ 54us) server_negotiation.cc:407] Connection header received
0806 20:31:50.346616 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:50.346646 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:50.347237 (+ 591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:50.347689 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:50.348250 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:50.350369 (+ 2119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:50.351849 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:50.352885 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:50.353070 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:50.354239 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:50.354250 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:50.354268 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:50.355015 (+ 747us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:50.355124 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:50.355149 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:50.355253 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:50.355493 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 20:31:50.355835 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":341,"threads_started":1}
I20260806 20:31:50.358291 22130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8: Bootstrap starting.
I20260806 20:31:50.361562 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:31:50.362295 22130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:50.363534 22130 log.cc:824] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:50.366536 22130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8: No bootstrap required, opened a new log
I20260806 20:31:50.373842 22130 raft_consensus.cc:348] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44159 } }
I20260806 20:31:50.374182 22130 raft_consensus.cc:374] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:50.374261 22130 raft_consensus.cc:729] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da5eb61f6ffa43f4aaa7c521743dedc8, State: Initialized, Role: FOLLOWER
I20260806 20:31:50.374753 22130 consensus_queue.cc:260] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44159 } }
I20260806 20:31:50.374955 22130 raft_consensus.cc:388] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:50.375044 22130 raft_consensus.cc:482] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:50.375165 22130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:50.377305 22130 raft_consensus.cc:504] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44159 } }
I20260806 20:31:50.377837 22130 leader_election.cc:302] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da5eb61f6ffa43f4aaa7c521743dedc8; no voters:
I20260806 20:31:50.378458 22130 leader_election.cc:288] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:50.378680 22137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:50.379475 22137 raft_consensus.cc:686] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [term 1 LEADER]: Becoming Leader. State: Replica: da5eb61f6ffa43f4aaa7c521743dedc8, State: Running, Role: LEADER
I20260806 20:31:50.379969 22137 consensus_queue.cc:237] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44159 } }
I20260806 20:31:50.380597 22130 sys_catalog.cc:564] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:50.382893 22139 sys_catalog.cc:455] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da5eb61f6ffa43f4aaa7c521743dedc8. Latest consensus state: current_term: 1 leader_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44159 } } }
I20260806 20:31:50.382928 22138 sys_catalog.cc:455] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5eb61f6ffa43f4aaa7c521743dedc8" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44159 } } }
I20260806 20:31:50.383388 22139 sys_catalog.cc:458] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:50.383551 22138 sys_catalog.cc:458] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:50.386821 22144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:50.392465 22144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:50.401283 22144 catalog_manager.cc:1347] Generated new cluster ID: 856fc2822921451bbeeaca6aa5f6631d
I20260806 20:31:50.401422 22144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:50.419735 22144 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:50.421149 22144 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:50.443562 22144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da5eb61f6ffa43f4aaa7c521743dedc8: Generated new TSK 0
I20260806 20:31:50.444478 22144 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 20:31:50.488516 22175 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 20:31:50.488765 22175 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 20:31:50.490752 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:50.459978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37638 (local address 127.13.149.126:44159)
0806 20:31:50.460234 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:50.460242 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:50.460668 (+ 426us) server_negotiation.cc:407] Connection header received
0806 20:31:50.461113 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:50.461118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:50.461191 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:50.461315 (+ 124us) server_negotiation.cc:226] Negotiated authn=JWT
0806 20:31:50.461982 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:50.462736 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:50.464883 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:50.465359 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:50.465458 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:50.466118 (+ 660us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 20:31:50.490192 (+ 24074us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36921/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 20:31:50.490500 (+ 308us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37638: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36921/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":79}
W20260806 20:31:50.490906 22135 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37638: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36921/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 20:31:50.492758 22172 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:50.459858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44159 (local address 127.0.0.1:37638)
0806 20:31:50.460551 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:50.460573 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:50.460768 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:50.461379 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:50.461385 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:50.461399 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0806 20:31:50.461817 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:50.461830 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:50.462886 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:50.462892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:50.464699 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:50.464716 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:50.465557 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:50.465564 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:50.465748 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:50.465831 (+ 83us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 20:31:50.490518 (+ 24687us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36921/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 20:31:50.490901 (+ 383us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.149.126:44159: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36921/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":330,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.13.149.126:44159: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36921/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 20:31:50.494910 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 22019
I20260806 20:31:50.496101 22119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:50.589630 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 22019
2026-08-06T20:31:50Z chronyd exiting
I20260806 20:31:50.654383 13909 test_util.cc:175] -----------------------------------------------
I20260806 20:31:50.654567 13909 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786048265930148-13909-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (786 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 20:31:50.658367 13909 mini_oidc.cc:152] Starting JWKS server
I20260806 20:31:50.660194 13909 webserver.cc:460] Webserver started at https://127.0.0.1:39249/ using document root <none> and password file <none>
I20260806 20:31:50.660439 13909 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 20:31:50.661154 13909 webserver.cc:460] Webserver started at http://127.0.0.1:43969/ using document root <none> and password file <none>
2026-08-06T20:31:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:50Z Disabled control of system clock
I20260806 20:31:50.692924 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40101
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:38065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:40101
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39249/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/testchainca.cert with env {}
W20260806 20:31:51.023682 22186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:51.024013 22186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:51.024190 22186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:51.031421 22186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:51.031595 22186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:51.031688 22186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:51.031800 22186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:51.031884 22186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 20:31:51.031976 22186 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 20:31:51.032055 22186 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39249/jwks.json
I20260806 20:31:51.041913 22186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:38065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:40101
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39249/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:51.043212 22186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:51.044510 22186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:51.056608 22192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:51.056866 22200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:51.056903 22193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:51.057828 22186 server_base.cc:1034] running on GCE node
I20260806 20:31:51.058564 22186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:51.059911 22186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:51.061149 22186 hybrid_clock.cc:648] HybridClock initialized: now 1786048311061108 us; error 53 us; skew 500 ppm
I20260806 20:31:51.061510 22186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:51.063737 22186 webserver.cc:460] Webserver started at http://127.13.149.126:38935/ using document root <none> and password file <none>
I20260806 20:31:51.064424 22186 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:51.064565 22186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:51.064975 22186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:51.067782 22186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "3526f002db704908adb7934e9a74e207"
format_stamp: "Formatted at 2026-08-06 20:31:51 on dist-test-slave-2kcd"
server_key: "35666f98c667d5dcb1f33452c272bf38"
server_key_iv: "7f2e8a002d4680c1e02eb50bd13ace40"
server_key_version: "encryptionkey@0"
I20260806 20:31:51.068605 22186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "3526f002db704908adb7934e9a74e207"
format_stamp: "Formatted at 2026-08-06 20:31:51 on dist-test-slave-2kcd"
server_key: "35666f98c667d5dcb1f33452c272bf38"
server_key_iv: "7f2e8a002d4680c1e02eb50bd13ace40"
server_key_version: "encryptionkey@0"
I20260806 20:31:51.073607 22186 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 20:31:51.076963 22208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:51.078289 22186 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:31:51.078485 22186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "3526f002db704908adb7934e9a74e207"
format_stamp: "Formatted at 2026-08-06 20:31:51 on dist-test-slave-2kcd"
server_key: "35666f98c667d5dcb1f33452c272bf38"
server_key_iv: "7f2e8a002d4680c1e02eb50bd13ace40"
server_key_version: "encryptionkey@0"
I20260806 20:31:51.078703 22186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:51.097618 22186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:51.098413 22186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:51.098734 22186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:51.117281 22186 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:40101
I20260806 20:31:51.117300 22285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:40101 every 8 connection(s)
I20260806 20:31:51.118638 22186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:51.122294 22289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:51.122702 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 22186
I20260806 20:31:51.122892 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:51.123565 13909 external_mini_cluster.cc:1428] Setting key 1f4c45b2ec4dfff69bd91e78e8589512
I20260806 20:31:51.135556 22289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207: Bootstrap starting.
I20260806 20:31:51.137121 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:51.125390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55842 (local address 127.13.149.126:40101)
0806 20:31:51.126393 (+ 1003us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:51.126404 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:51.126444 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:31:51.128207 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:51.128229 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:51.128706 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:51.129091 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:51.129643 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.130871 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.132716 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.133448 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.133571 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:51.134800 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:51.134808 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:51.134820 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:51.135328 (+ 508us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:51.135399 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:51.135419 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:51.135502 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:51.135804 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 20:31:51.136141 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":388,"threads_started":1}
I20260806 20:31:51.138834 22289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:51.140044 22289 log.cc:824] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:51.140769 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:31:51.142772 22289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207: No bootstrap required, opened a new log
I20260806 20:31:51.149896 22289 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3526f002db704908adb7934e9a74e207" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40101 } }
I20260806 20:31:51.150254 22289 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:51.150368 22289 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3526f002db704908adb7934e9a74e207, State: Initialized, Role: FOLLOWER
I20260806 20:31:51.150964 22289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3526f002db704908adb7934e9a74e207" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40101 } }
I20260806 20:31:51.151214 22289 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:51.151355 22289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:51.151547 22289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:51.153944 22289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3526f002db704908adb7934e9a74e207" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40101 } }
I20260806 20:31:51.154512 22289 leader_election.cc:302] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3526f002db704908adb7934e9a74e207; no voters:
I20260806 20:31:51.155097 22289 leader_election.cc:288] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:51.155238 22296 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:51.156651 22296 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [term 1 LEADER]: Becoming Leader. State: Replica: 3526f002db704908adb7934e9a74e207, State: Running, Role: LEADER
I20260806 20:31:51.157328 22289 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:51.157176 22296 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3526f002db704908adb7934e9a74e207" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40101 } }
I20260806 20:31:51.160254 22298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3526f002db704908adb7934e9a74e207. Latest consensus state: current_term: 1 leader_uuid: "3526f002db704908adb7934e9a74e207" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3526f002db704908adb7934e9a74e207" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40101 } } }
I20260806 20:31:51.161051 22298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:51.160568 22297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3526f002db704908adb7934e9a74e207" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3526f002db704908adb7934e9a74e207" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40101 } } }
I20260806 20:31:51.161382 22297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:51.163211 22310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:51.168216 22310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:51.177346 22310 catalog_manager.cc:1347] Generated new cluster ID: aa0f658a004c4ae6a4ecc980d16be43b
I20260806 20:31:51.177484 22310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:51.191689 22310 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:51.193059 22310 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:51.209882 22310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3526f002db704908adb7934e9a74e207: Generated new TSK 0
I20260806 20:31:51.210896 22310 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 20:31:51.251109 22333 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 20:31:51.251250 22333 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 20:31:51.252094 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:51.231503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55850 (local address 127.13.149.126:40101)
0806 20:31:51.231703 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:51.231709 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:51.232143 (+ 434us) server_negotiation.cc:407] Connection header received
0806 20:31:51.232364 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:51.232370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:51.232489 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:51.232667 (+ 178us) server_negotiation.cc:226] Negotiated authn=JWT
0806 20:31:51.233198 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.234353 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.235752 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.236501 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.236641 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:51.237198 (+ 557us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 20:31:51.251309 (+ 14111us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 20:31:51.251760 (+ 451us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55850: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":76}
W20260806 20:31:51.252239 22293 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55850: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 20:31:51.252310 22331 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:51.231367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:40101 (local address 127.0.0.1:55850)
0806 20:31:51.232029 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:51.232050 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:51.232178 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:51.232683 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:51.232686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:51.232696 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0806 20:31:51.233026 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:51.233035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.234496 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.234500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:51.235600 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:51.235612 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.236677 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.236681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:51.236859 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:51.236895 (+ 36us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 20:31:51.251588 (+ 14693us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 20:31:51.251875 (+ 287us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.149.126:40101: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":364,"threads_started":1}
I20260806 20:31:51.253638 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 22186
I20260806 20:31:51.254904 22281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:51.348665 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 22186
2026-08-06T20:31:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (755 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 20:31:51.414149 13909 mini_oidc.cc:152] Starting JWKS server
I20260806 20:31:51.416103 13909 webserver.cc:460] Webserver started at https://127.0.0.1:35927/ using document root <none> and password file <none>
I20260806 20:31:51.416360 13909 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 20:31:51.417071 13909 webserver.cc:460] Webserver started at http://127.0.0.1:40935/ using document root <none> and password file <none>
2026-08-06T20:31:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:51Z Disabled control of system clock
I20260806 20:31:51.450824 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42991
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:38943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:42991
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35927/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 20:31:51.779345 22346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:51.779672 22346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:51.779837 22346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:51.786859 22346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:51.787012 22346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:51.787103 22346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:51.787195 22346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:51.787264 22346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 20:31:51.787354 22346 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 20:31:51.787431 22346 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35927/jwks.json
I20260806 20:31:51.796228 22346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:38943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:42991
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35927/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:51.797570 22346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:51.799388 22346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:51.811147 22357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:51.811285 22353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:51.811259 22354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:51.812049 22346 server_base.cc:1034] running on GCE node
I20260806 20:31:51.812901 22346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:51.814194 22346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:51.815423 22346 hybrid_clock.cc:648] HybridClock initialized: now 1786048311815386 us; error 49 us; skew 500 ppm
I20260806 20:31:51.815771 22346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:51.822139 22346 webserver.cc:460] Webserver started at http://127.13.149.126:36755/ using document root <none> and password file <none>
I20260806 20:31:51.822849 22346 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:51.822992 22346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:51.823331 22346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:51.826215 22346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "559de689860148e3b8da67dcf7d03c15"
format_stamp: "Formatted at 2026-08-06 20:31:51 on dist-test-slave-2kcd"
server_key: "3bc28b631a2fbd72b589019c1ab671a2"
server_key_iv: "9d151abbd23375b63c105f57bdc8a55b"
server_key_version: "encryptionkey@0"
I20260806 20:31:51.827014 22346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "559de689860148e3b8da67dcf7d03c15"
format_stamp: "Formatted at 2026-08-06 20:31:51 on dist-test-slave-2kcd"
server_key: "3bc28b631a2fbd72b589019c1ab671a2"
server_key_iv: "9d151abbd23375b63c105f57bdc8a55b"
server_key_version: "encryptionkey@0"
I20260806 20:31:51.831851 22346 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 20:31:51.835178 22367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:51.836429 22346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:31:51.836613 22346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "559de689860148e3b8da67dcf7d03c15"
format_stamp: "Formatted at 2026-08-06 20:31:51 on dist-test-slave-2kcd"
server_key: "3bc28b631a2fbd72b589019c1ab671a2"
server_key_iv: "9d151abbd23375b63c105f57bdc8a55b"
server_key_version: "encryptionkey@0"
I20260806 20:31:51.836844 22346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:51.868788 22346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:51.869555 22346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:51.869871 22346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:51.888180 22346 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:42991
I20260806 20:31:51.888199 22454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:42991 every 8 connection(s)
I20260806 20:31:51.889509 22346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:51.891390 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 22346
I20260806 20:31:51.891623 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:51.892462 13909 external_mini_cluster.cc:1428] Setting key 11e8a149300597589fa32bb6309c5b88
I20260806 20:31:51.894130 22455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:51.906052 22459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:51.894500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37718 (local address 127.13.149.126:42991)
0806 20:31:51.895440 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:51.895475 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:51.895518 (+ 43us) server_negotiation.cc:407] Connection header received
0806 20:31:51.897134 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:51.897154 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:51.897598 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:51.897916 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:51.898546 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.899868 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.901784 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.902398 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.902539 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:51.903752 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:51.903759 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:51.903775 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:51.904310 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:51.904390 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:51.904413 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:51.904515 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:51.904761 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 20:31:51.905146 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":381,"threads_started":1}
I20260806 20:31:51.907480 22455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15: Bootstrap starting.
I20260806 20:31:51.909842 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:31:51.910866 22455 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:51.911876 22455 log.cc:824] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:51.914723 22455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15: No bootstrap required, opened a new log
I20260806 20:31:51.921797 22455 raft_consensus.cc:348] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559de689860148e3b8da67dcf7d03c15" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42991 } }
I20260806 20:31:51.922169 22455 raft_consensus.cc:374] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:51.922276 22455 raft_consensus.cc:729] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559de689860148e3b8da67dcf7d03c15, State: Initialized, Role: FOLLOWER
I20260806 20:31:51.922894 22455 consensus_queue.cc:260] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559de689860148e3b8da67dcf7d03c15" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42991 } }
I20260806 20:31:51.923151 22455 raft_consensus.cc:388] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:51.923290 22455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:51.923476 22455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:51.925689 22455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559de689860148e3b8da67dcf7d03c15" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42991 } }
I20260806 20:31:51.926190 22455 leader_election.cc:302] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 559de689860148e3b8da67dcf7d03c15; no voters:
I20260806 20:31:51.926765 22455 leader_election.cc:288] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:51.926898 22463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:51.927660 22463 raft_consensus.cc:686] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [term 1 LEADER]: Becoming Leader. State: Replica: 559de689860148e3b8da67dcf7d03c15, State: Running, Role: LEADER
I20260806 20:31:51.928208 22463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559de689860148e3b8da67dcf7d03c15" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42991 } }
I20260806 20:31:51.928937 22455 sys_catalog.cc:564] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:51.931102 22465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 559de689860148e3b8da67dcf7d03c15. Latest consensus state: current_term: 1 leader_uuid: "559de689860148e3b8da67dcf7d03c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559de689860148e3b8da67dcf7d03c15" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42991 } } }
I20260806 20:31:51.931643 22465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:51.931578 22464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "559de689860148e3b8da67dcf7d03c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559de689860148e3b8da67dcf7d03c15" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42991 } } }
I20260806 20:31:51.931878 22464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:51.933977 22477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:51.938870 22477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:51.948038 22477 catalog_manager.cc:1347] Generated new cluster ID: 36b1a5e809f34f04b089a7960355b7a9
I20260806 20:31:51.948138 22477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:51.962769 22477 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:51.964093 22477 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:51.970013 22477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 559de689860148e3b8da67dcf7d03c15: Generated new TSK 0
I20260806 20:31:51.970723 22477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:31:51.997395 22459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:51.988975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37720 (local address 127.13.149.126:42991)
0806 20:31:51.989215 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:51.989221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:51.989617 (+ 396us) server_negotiation.cc:407] Connection header received
0806 20:31:51.989848 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:51.989852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:51.989927 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:51.990059 (+ 132us) server_negotiation.cc:226] Negotiated authn=JWT
0806 20:31:51.990672 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.991417 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.993367 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.993794 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.993884 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:51.994465 (+ 581us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 20:31:51.996748 (+ 2283us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 20:31:51.997099 (+ 351us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37720: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":69}
W20260806 20:31:51.997524 22459 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37720: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 20:31:51.999586 22498 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:51.988855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42991 (local address 127.0.0.1:37720)
0806 20:31:51.989505 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:51.989528 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:51.989677 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:51.990111 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:51.990116 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:51.990133 (+ 17us) client_negotiation.cc:189] Negotiated authn=JWT
0806 20:31:51.990516 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:51.990531 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.991562 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.991568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:51.993231 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:51.993246 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:51.993985 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:51.993993 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:51.994184 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:51.994232 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 20:31:51.996989 (+ 2757us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 20:31:51.999133 (+ 2144us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.149.126:42991: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":1837,"thread_start_us":327,"threads_started":1}
I20260806 20:31:52.000618 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 22346
I20260806 20:31:52.001716 22447 generic_service.cc:196] Checking for leaks (request via RPC)
E20260806 20:31:52.009594 22499 webserver.cc:533] Webserver: sslize failed:
E20260806 20:31:52.009716 22499 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 20:31:52.094628 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 22346
2026-08-06T20:31:52Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (744 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T20:31:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:52Z Disabled control of system clock
I20260806 20:31:52.192478 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44405
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:45885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:44405
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/testchainca.cert with env {}
W20260806 20:31:52.544970 22506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:52.545369 22506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:52.545544 22506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:52.552881 22506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:52.553010 22506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:52.553102 22506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:52.553210 22506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:52.553294 22506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 20:31:52.553382 22506 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 20:31:52.553436 22506 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 20:31:52.563654 22506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:44405
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:52.565099 22506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:52.566516 22506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:52.578919 22512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:52.578984 22515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:52.579145 22519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:52.579749 22506 server_base.cc:1034] running on GCE node
I20260806 20:31:52.580482 22506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:52.581930 22506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:52.583156 22506 hybrid_clock.cc:648] HybridClock initialized: now 1786048312583126 us; error 53 us; skew 500 ppm
I20260806 20:31:52.583490 22506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:31:52.585767 22506 webserver.cc:460] Webserver started at http://127.13.149.126:45983/ using document root <none> and password file <none>
I20260806 20:31:52.586449 22506 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:52.586593 22506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:52.586901 22506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:52.589788 22506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "43f792d260824dbcb0d4ec09e240e6a0"
format_stamp: "Formatted at 2026-08-06 20:31:52 on dist-test-slave-2kcd"
server_key: "de9d53c56b0de288d493dcb90cce598b"
server_key_iv: "d4eb0f3378fa94099eba0293219f6421"
server_key_version: "encryptionkey@0"
I20260806 20:31:52.590608 22506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "43f792d260824dbcb0d4ec09e240e6a0"
format_stamp: "Formatted at 2026-08-06 20:31:52 on dist-test-slave-2kcd"
server_key: "de9d53c56b0de288d493dcb90cce598b"
server_key_iv: "d4eb0f3378fa94099eba0293219f6421"
server_key_version: "encryptionkey@0"
I20260806 20:31:52.595566 22506 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 20:31:52.599027 22529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:52.600401 22506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:31:52.600591 22506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "43f792d260824dbcb0d4ec09e240e6a0"
format_stamp: "Formatted at 2026-08-06 20:31:52 on dist-test-slave-2kcd"
server_key: "de9d53c56b0de288d493dcb90cce598b"
server_key_iv: "d4eb0f3378fa94099eba0293219f6421"
server_key_version: "encryptionkey@0"
I20260806 20:31:52.600831 22506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:52.612313 22506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:52.613159 22506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:52.613438 22506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:52.631991 22506 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:44405
I20260806 20:31:52.632025 22609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:44405 every 8 connection(s)
I20260806 20:31:52.633374 22506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:52.637264 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 22506
I20260806 20:31:52.637414 22610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:52.637488 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:52.638351 13909 external_mini_cluster.cc:1428] Setting key f4b779ef4127c8a2feb9f69326e473a1
I20260806 20:31:52.652505 22610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0: Bootstrap starting.
I20260806 20:31:52.654747 22615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:52.640592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55572 (local address 127.13.149.126:44405)
0806 20:31:52.642367 (+ 1775us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:52.642381 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:52.642435 (+ 54us) server_negotiation.cc:407] Connection header received
0806 20:31:52.644323 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:52.644351 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:52.644982 (+ 631us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:52.645435 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:52.645970 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:52.647835 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:52.649271 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:52.650375 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:52.650567 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:52.651834 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:52.651845 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:52.651865 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:31:52.652620 (+ 755us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:52.652726 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:31:52.652752 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:52.652888 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:52.653084 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 20:31:52.653403 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1237,"thread_start_us":921,"threads_started":1}
I20260806 20:31:52.656455 22610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:52.657850 22610 log.cc:824] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:52.658789 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:31:52.660912 22610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0: No bootstrap required, opened a new log
I20260806 20:31:52.669030 22610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f792d260824dbcb0d4ec09e240e6a0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44405 } }
I20260806 20:31:52.669350 22610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:52.669425 22610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f792d260824dbcb0d4ec09e240e6a0, State: Initialized, Role: FOLLOWER
I20260806 20:31:52.669957 22610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f792d260824dbcb0d4ec09e240e6a0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44405 } }
I20260806 20:31:52.670274 22610 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:52.670455 22610 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:52.670653 22610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:52.672850 22610 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f792d260824dbcb0d4ec09e240e6a0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44405 } }
I20260806 20:31:52.673326 22610 leader_election.cc:302] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43f792d260824dbcb0d4ec09e240e6a0; no voters:
I20260806 20:31:52.673959 22610 leader_election.cc:288] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:52.674108 22619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:52.675166 22619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [term 1 LEADER]: Becoming Leader. State: Replica: 43f792d260824dbcb0d4ec09e240e6a0, State: Running, Role: LEADER
I20260806 20:31:52.675722 22619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f792d260824dbcb0d4ec09e240e6a0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44405 } }
I20260806 20:31:52.676090 22610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:52.678505 22622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43f792d260824dbcb0d4ec09e240e6a0. Latest consensus state: current_term: 1 leader_uuid: "43f792d260824dbcb0d4ec09e240e6a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f792d260824dbcb0d4ec09e240e6a0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44405 } } }
I20260806 20:31:52.678886 22622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:52.679390 22621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43f792d260824dbcb0d4ec09e240e6a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f792d260824dbcb0d4ec09e240e6a0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44405 } } }
I20260806 20:31:52.679773 22621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0 [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:52.682837 22632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:52.687923 22632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:52.695439 22632 catalog_manager.cc:1347] Generated new cluster ID: 2d1324b459c24b4bbf2255ecdc1445f5
I20260806 20:31:52.695544 22632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:52.707376 22632 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:52.709023 22632 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:52.715968 22632 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43f792d260824dbcb0d4ec09e240e6a0: Generated new TSK 0
I20260806 20:31:52.716938 22632 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:31:53.178825 22615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:52.743539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55574 (local address 127.13.149.126:44405)
0806 20:31:52.743771 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:52.743778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:52.744194 (+ 416us) server_negotiation.cc:407] Connection header received
0806 20:31:52.744428 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:52.744432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:52.744508 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:52.744654 (+ 146us) server_negotiation.cc:226] Negotiated authn=JWT
0806 20:31:52.745237 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:52.746061 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:52.748112 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:52.748614 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:52.748723 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:52.749380 (+ 657us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 20:31:53.178258 (+428878us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 20:31:53.178591 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55574: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 20:31:53.178959 22615 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55574: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 20:31:53.179327 22658 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:52.743433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44405 (local address 127.0.0.1:55574)
0806 20:31:52.744066 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:52.744086 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:52.744236 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:52.744699 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:52.744704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:52.744718 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0806 20:31:52.745063 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:52.745076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:52.746225 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:52.746231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:52.747942 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:52.747957 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:52.748810 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:52.748817 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:52.749034 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:52.749080 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 20:31:53.178555 (+429475us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 20:31:53.178794 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.149.126:44405: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":309,"threads_started":1}
I20260806 20:31:53.180477 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 22506
I20260806 20:31:53.181720 22601 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:53.285079 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 22506
2026-08-06T20:31:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1172 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (425 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (424 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:54 dist-test-slave-2kcd krb5kdc[22680](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:54 dist-test-slave-2kcd krb5kdc[22680](info): set up 2 sockets
Aug 06 20:31:54 dist-test-slave-2kcd krb5kdc[22680](info): commencing operation
krb5kdc: starting...
W20260806 20:31:55.454788 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:55 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:31:55.683907 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38753
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:44039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:38753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:56.023907 22702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:56.024196 22702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:56.024374 22702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:56.031589 22702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:31:56.031719 22702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:56.031826 22702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:56.031924 22702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:31:56.032022 22702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:31:56.041853 22702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:44039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:38753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:56.043146 22702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:56.044443 22702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:56.056231 22716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:56.056274 22709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:56.056190 22711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:56.057169 22702 server_base.cc:1034] running on GCE node
I20260806 20:31:56.057973 22702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:56.059353 22702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:56.060599 22702 hybrid_clock.cc:648] HybridClock initialized: now 1786048316060548 us; error 57 us; skew 500 ppm
I20260806 20:31:56.060998 22702 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:56 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048316, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:56.064083 22702 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:31:56.065586 22702 webserver.cc:460] Webserver started at http://127.13.149.126:37105/ using document root <none> and password file <none>
I20260806 20:31:56.066263 22702 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:56.066414 22702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:56.066768 22702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:56.069823 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "007eff4b956d4de6b6ade376d342e54a"
format_stamp: "Formatted at 2026-08-06 20:31:56 on dist-test-slave-2kcd"
server_key: "76bc61e57afd2bc105737a2012892a03"
server_key_iv: "432e8b506cf383829dd72030b8e54794"
server_key_version: "encryptionkey@0"
I20260806 20:31:56.070612 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "007eff4b956d4de6b6ade376d342e54a"
format_stamp: "Formatted at 2026-08-06 20:31:56 on dist-test-slave-2kcd"
server_key: "76bc61e57afd2bc105737a2012892a03"
server_key_iv: "432e8b506cf383829dd72030b8e54794"
server_key_version: "encryptionkey@0"
I20260806 20:31:56.075708 22702 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:31:56.079175 22730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:56.080533 22702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 20:31:56.080724 22702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "007eff4b956d4de6b6ade376d342e54a"
format_stamp: "Formatted at 2026-08-06 20:31:56 on dist-test-slave-2kcd"
server_key: "76bc61e57afd2bc105737a2012892a03"
server_key_iv: "432e8b506cf383829dd72030b8e54794"
server_key_version: "encryptionkey@0"
I20260806 20:31:56.081002 22702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:56.094594 22702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:56.098485 22702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:56.098766 22702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:56.117909 22702 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:38753
I20260806 20:31:56.117944 22807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:38753 every 8 connection(s)
I20260806 20:31:56.119352 22702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:31:56.123144 22808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:31:56.128136 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 22702
I20260806 20:31:56.128379 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:31:56.129261 13909 external_mini_cluster.cc:1428] Setting key 5c964bcf50d701eb2f59500a38a30029
I20260806 20:31:56.135125 22808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a: Bootstrap starting.
I20260806 20:31:56.139035 22808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a: Neither blocks nor log segments found. Creating new log.
I20260806 20:31:56.140290 22808 log.cc:824] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a: Log is configured to *not* fsync() on all Append() calls
I20260806 20:31:56.143103 22808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a: No bootstrap required, opened a new log
Aug 06 20:31:56 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:56.153584 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:56.131410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38166 (local address 127.13.149.126:38753)
0806 20:31:56.132301 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:56.132312 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:56.132356 (+ 44us) server_negotiation.cc:407] Connection header received
0806 20:31:56.134186 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:56.134210 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:56.134606 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:56.134935 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:56.136893 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:56.138210 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:56.139980 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:56.140696 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:56.140992 (+ 296us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:56.144897 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:56.144906 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:56.144926 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:56.144969 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:56.149071 (+ 4102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:56.149736 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:56.149745 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:56.149753 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:56.149965 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:56.150304 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:56.150309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:56.150313 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:56.151044 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:56.151342 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:56.151684 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 20:31:56.152145 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":433,"threads_started":1}
I20260806 20:31:56.153940 22808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007eff4b956d4de6b6ade376d342e54a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38753 } }
I20260806 20:31:56.154413 22808 raft_consensus.cc:374] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:31:56.154525 22808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 007eff4b956d4de6b6ade376d342e54a, State: Initialized, Role: FOLLOWER
I20260806 20:31:56.155146 22808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007eff4b956d4de6b6ade376d342e54a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38753 } }
I20260806 20:31:56.155392 22808 raft_consensus.cc:388] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:31:56.155565 22808 raft_consensus.cc:482] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:31:56.155751 22808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:31:56.158257 22808 raft_consensus.cc:504] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007eff4b956d4de6b6ade376d342e54a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38753 } }
I20260806 20:31:56.158752 22808 leader_election.cc:302] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 007eff4b956d4de6b6ade376d342e54a; no voters:
I20260806 20:31:56.159313 22808 leader_election.cc:288] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:31:56.159443 22814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:31:56.160145 22814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [term 1 LEADER]: Becoming Leader. State: Replica: 007eff4b956d4de6b6ade376d342e54a, State: Running, Role: LEADER
I20260806 20:31:56.160681 22814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007eff4b956d4de6b6ade376d342e54a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38753 } }
I20260806 20:31:56.161451 22808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:31:56.163573 22817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "007eff4b956d4de6b6ade376d342e54a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007eff4b956d4de6b6ade376d342e54a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38753 } } }
I20260806 20:31:56.163673 22818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 007eff4b956d4de6b6ade376d342e54a. Latest consensus state: current_term: 1 leader_uuid: "007eff4b956d4de6b6ade376d342e54a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "007eff4b956d4de6b6ade376d342e54a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38753 } } }
I20260806 20:31:56.164017 22817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:56.164063 22818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a [sys.catalog]: This master's current role is: LEADER
I20260806 20:31:56.165974 22825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:31:56.171165 22825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:31:56.181072 22825 catalog_manager.cc:1347] Generated new cluster ID: cf23c1dc2c64457ebefe9f3494817c8e
I20260806 20:31:56.181191 22825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:31:56.198673 22825 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:31:56.200215 22825 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:31:56.205878 22825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 007eff4b956d4de6b6ade376d342e54a: Generated new TSK 0
I20260806 20:31:56.206723 22825 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:31:56.264323 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38753
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:44039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:56.618880 22852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:56.619136 22852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:56.619239 22852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:56.626247 22852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:56.626350 22852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:56.626458 22852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:31:56.635782 22852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:44039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:56.636983 22852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:56.638216 22852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:56.651669 22860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:56.651582 22865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:56.651630 22861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:56.653352 22852 server_base.cc:1034] running on GCE node
I20260806 20:31:56.654028 22852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:56.655061 22852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:56.656329 22852 hybrid_clock.cc:648] HybridClock initialized: now 1786048316656266 us; error 37 us; skew 500 ppm
I20260806 20:31:56.656684 22852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:56 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048316, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:56.660033 22852 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:31:56.661621 22852 webserver.cc:460] Webserver started at http://127.13.149.65:42667/ using document root <none> and password file <none>
I20260806 20:31:56.662413 22852 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:56.662571 22852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:56.663075 22852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:56.666427 22852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "a10dc11366d74be485bf752161c5f0cd"
format_stamp: "Formatted at 2026-08-06 20:31:56 on dist-test-slave-2kcd"
server_key: "f5824715818ad3924f9cc24b4fc53646"
server_key_iv: "42637723d3dbade83d0f13932482ba17"
server_key_version: "encryptionkey@0"
I20260806 20:31:56.667291 22852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "a10dc11366d74be485bf752161c5f0cd"
format_stamp: "Formatted at 2026-08-06 20:31:56 on dist-test-slave-2kcd"
server_key: "f5824715818ad3924f9cc24b4fc53646"
server_key_iv: "42637723d3dbade83d0f13932482ba17"
server_key_version: "encryptionkey@0"
I20260806 20:31:56.673265 22852 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 20:31:56.676774 22878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:56.678123 22852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:31:56.678324 22852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "a10dc11366d74be485bf752161c5f0cd"
format_stamp: "Formatted at 2026-08-06 20:31:56 on dist-test-slave-2kcd"
server_key: "f5824715818ad3924f9cc24b4fc53646"
server_key_iv: "42637723d3dbade83d0f13932482ba17"
server_key_version: "encryptionkey@0"
I20260806 20:31:56.678534 22852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:56.711486 22852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:56.715464 22852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:56.715765 22852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:56.716701 22852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:56.718101 22852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:56.718207 22852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:56.718358 22852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:56.718434 22852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:56.751895 22852 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:42281
I20260806 20:31:56.751945 23060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:42281 every 8 connection(s)
I20260806 20:31:56.753305 22852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:31:56.762737 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 22852
I20260806 20:31:56.762970 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:31:56.763790 13909 external_mini_cluster.cc:1428] Setting key dfa86d3faba0f9b865b6e86165ef1c6c
Aug 06 20:31:56 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048316, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:56.774691 23068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:56.755823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:37755 (local address 127.13.149.126:38753)
0806 20:31:56.756290 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:56.756295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:56.757110 (+ 815us) server_negotiation.cc:407] Connection header received
0806 20:31:56.758912 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:56.758918 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:56.759024 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:56.759148 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:56.760651 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:56.761520 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:56.763352 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:56.764026 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:56.764156 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:56.767701 (+ 3545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:56.767710 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:56.767717 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:56.767766 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:56.771421 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:56.772134 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:56.772142 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:56.772148 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:56.772298 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:56.772703 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:56.772710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:56.772716 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:56.773128 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:56.773301 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:56.773958 (+ 657us) server_negotiation.cc:299] Negotiation successful
0806 20:31:56.774214 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":243,"threads_started":1}
I20260806 20:31:56.775323 23069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:56.756216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38753 (local address 127.13.149.65:37755)
0806 20:31:56.756938 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:56.756975 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:56.758638 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:56.759385 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:56.759393 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:56.759888 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:56.760464 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:56.760480 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:56.761715 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:56.761720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:56.763201 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:56.763214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:56.764235 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:56.764240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:56.764432 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:56.765180 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:56.765208 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:56.767478 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:56.771565 (+ 4087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:56.771571 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:56.771583 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:56.772015 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:56.772418 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:56.772421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:56.772423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:56.772596 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:56.773269 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:56.773275 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:56.773586 (+ 311us) client_negotiation.cc:769] Sending connection context
0806 20:31:56.773823 (+ 237us) client_negotiation.cc:240] Negotiation successful
0806 20:31:56.774221 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":304,"threads_started":1}
I20260806 20:31:56.776899 23063 heartbeater.cc:347] Connected to a master server at 127.13.149.126:38753
I20260806 20:31:56.777233 23063 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:56.777971 23063 heartbeater.cc:511] Master 127.13.149.126:38753 requested a full tablet report, sending...
I20260806 20:31:56.780069 22757 ts_manager.cc:194] Registered new tserver with Master: a10dc11366d74be485bf752161c5f0cd (127.13.149.65:42281)
I20260806 20:31:56.781615 22757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:37755
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:31:56.821748 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38753
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:44039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:57.159467 23072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:57.159782 23072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:57.159952 23072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:57.167603 23072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:57.167739 23072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:57.167918 23072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:31:57.177803 23072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:44039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:57.179095 23072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:57.180594 23072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:57.194502 23082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:57.194473 23078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:57.194542 23079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:57.195339 23072 server_base.cc:1034] running on GCE node
I20260806 20:31:57.195931 23072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:57.196889 23072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:57.198149 23072 hybrid_clock.cc:648] HybridClock initialized: now 1786048317198106 us; error 30 us; skew 500 ppm
I20260806 20:31:57.198455 23072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.204638 23072 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:31:57.206240 23072 webserver.cc:460] Webserver started at http://127.13.149.66:39109/ using document root <none> and password file <none>
I20260806 20:31:57.206940 23072 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:57.207098 23072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:57.207437 23072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:57.210491 23072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "848fa53086bc407cb524dbd58713c159"
format_stamp: "Formatted at 2026-08-06 20:31:57 on dist-test-slave-2kcd"
server_key: "2417f19ed0dddfe9ba5231607cd0546c"
server_key_iv: "1f33de7195d5dd3c32fd00efa1a005ae"
server_key_version: "encryptionkey@0"
I20260806 20:31:57.211294 23072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "848fa53086bc407cb524dbd58713c159"
format_stamp: "Formatted at 2026-08-06 20:31:57 on dist-test-slave-2kcd"
server_key: "2417f19ed0dddfe9ba5231607cd0546c"
server_key_iv: "1f33de7195d5dd3c32fd00efa1a005ae"
server_key_version: "encryptionkey@0"
I20260806 20:31:57.216718 23072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260806 20:31:57.220165 23094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:57.221474 23072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:31:57.221652 23072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "848fa53086bc407cb524dbd58713c159"
format_stamp: "Formatted at 2026-08-06 20:31:57 on dist-test-slave-2kcd"
server_key: "2417f19ed0dddfe9ba5231607cd0546c"
server_key_iv: "1f33de7195d5dd3c32fd00efa1a005ae"
server_key_version: "encryptionkey@0"
I20260806 20:31:57.221858 23072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:57.256039 23072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:57.260207 23072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:57.260509 23072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:57.261658 23072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:57.263258 23072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:57.263357 23072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:57.263506 23072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:57.263576 23072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:57.298509 23072 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:33141
I20260806 20:31:57.298599 23267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:33141 every 8 connection(s)
I20260806 20:31:57.299814 23072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:31:57.306206 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 23072
I20260806 20:31:57.306382 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:31:57.306849 13909 external_mini_cluster.cc:1428] Setting key 0e3ddbb4faf7f5c390781b4a56fa7e46
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:57.320955 23272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.302369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:53519 (local address 127.13.149.126:38753)
0806 20:31:57.302825 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.302829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.303794 (+ 965us) server_negotiation.cc:407] Connection header received
0806 20:31:57.305683 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.305688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.305783 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.305904 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.307520 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.308294 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.309891 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.310333 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.310466 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.314102 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:57.314111 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:57.314118 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:57.314175 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:57.317843 (+ 3668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.318561 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.318570 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.318576 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.318752 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.319260 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.319263 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.319265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.319531 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:57.319640 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:57.320447 (+ 807us) server_negotiation.cc:299] Negotiation successful
0806 20:31:57.320617 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":226,"threads_started":1}
I20260806 20:31:57.322207 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.302930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38753 (local address 127.13.149.66:53519)
0806 20:31:57.303642 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:57.303679 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:57.305406 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:57.306146 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:57.306154 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:57.306749 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:57.307345 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:57.307363 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.308446 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.308456 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:57.309744 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:57.309757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.310586 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.310594 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:57.310816 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.311510 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:57.311536 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:57.313871 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:57.318000 (+ 4129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:57.318007 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:57.318018 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:57.318417 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:57.318882 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:57.318888 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:57.318893 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:57.319145 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:57.319659 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:57.319670 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:57.320117 (+ 447us) client_negotiation.cc:769] Sending connection context
0806 20:31:57.320363 (+ 246us) client_negotiation.cc:240] Negotiation successful
0806 20:31:57.320729 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":288,"threads_started":1}
I20260806 20:31:57.323675 23268 heartbeater.cc:347] Connected to a master server at 127.13.149.126:38753
I20260806 20:31:57.323972 23268 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:57.324669 23268 heartbeater.cc:511] Master 127.13.149.126:38753 requested a full tablet report, sending...
I20260806 20:31:57.326157 22757 ts_manager.cc:194] Registered new tserver with Master: 848fa53086bc407cb524dbd58713c159 (127.13.149.66:33141)
I20260806 20:31:57.327023 22757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:53519
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:31:57.362332 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38753
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:44039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:31:57.694242 23278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:31:57.694499 23278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:31:57.694661 23278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:31:57.701632 23278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:31:57.701751 23278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:31:57.701946 23278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:31:57.711481 23278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:44039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:31:57.712813 23278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:31:57.714140 23278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:31:57.727221 23286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:57.727268 23287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:31:57.727201 23290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:31:57.730274 23278 server_base.cc:1034] running on GCE node
I20260806 20:31:57.730906 23278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:31:57.731876 23278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:31:57.733112 23278 hybrid_clock.cc:648] HybridClock initialized: now 1786048317733067 us; error 43 us; skew 500 ppm
I20260806 20:31:57.733428 23278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.736588 23278 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:31:57.738189 23278 webserver.cc:460] Webserver started at http://127.13.149.67:42131/ using document root <none> and password file <none>
I20260806 20:31:57.738883 23278 fs_manager.cc:359] Metadata directory not provided
I20260806 20:31:57.739039 23278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:31:57.739354 23278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:31:57.742321 23278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "3b5b9b1e21194dc5988d2986e3003cbb"
format_stamp: "Formatted at 2026-08-06 20:31:57 on dist-test-slave-2kcd"
server_key: "fddaeb40990a7fbdf182ef90ba6a19c3"
server_key_iv: "c16ab43861ccd20394590a06ff665651"
server_key_version: "encryptionkey@0"
I20260806 20:31:57.743111 23278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "3b5b9b1e21194dc5988d2986e3003cbb"
format_stamp: "Formatted at 2026-08-06 20:31:57 on dist-test-slave-2kcd"
server_key: "fddaeb40990a7fbdf182ef90ba6a19c3"
server_key_iv: "c16ab43861ccd20394590a06ff665651"
server_key_version: "encryptionkey@0"
I20260806 20:31:57.748056 23278 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:31:57.751535 23303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:57.752898 23278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:31:57.753075 23278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "3b5b9b1e21194dc5988d2986e3003cbb"
format_stamp: "Formatted at 2026-08-06 20:31:57 on dist-test-slave-2kcd"
server_key: "fddaeb40990a7fbdf182ef90ba6a19c3"
server_key_iv: "c16ab43861ccd20394590a06ff665651"
server_key_version: "encryptionkey@0"
I20260806 20:31:57.753269 23278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:31:57.769899 23278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:31:57.774039 23278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:31:57.774334 23278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:31:57.775192 23278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:31:57.776536 23278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:31:57.776638 23278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:31:57.776834 23278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:31:57.776917 23278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 20:31:57.784993 23063 heartbeater.cc:503] Master 127.13.149.126:38753 was elected leader, sending a full tablet report...
I20260806 20:31:57.810730 23278 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:46493
I20260806 20:31:57.810807 23470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:46493 every 8 connection(s)
I20260806 20:31:57.811939 23278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:31:57.816452 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 23278
I20260806 20:31:57.816640 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:31:57.817173 13909 external_mini_cluster.cc:1428] Setting key d7f0c16ab3205597dba8c5ba904033e9
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:31:57.832309 23272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.814399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:33087 (local address 127.13.149.126:38753)
0806 20:31:57.814614 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.814620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.815776 (+ 1156us) server_negotiation.cc:407] Connection header received
0806 20:31:57.817747 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.817752 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.817828 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.817950 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.819591 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.820351 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.821931 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.822332 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.822471 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.825957 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:57.825963 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:57.825966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:57.826013 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:57.829011 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.829774 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.829782 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.829786 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.829924 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.830434 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.830439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.830441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.830779 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:57.830985 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:57.831806 (+ 821us) server_negotiation.cc:299] Negotiation successful
0806 20:31:57.831998 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 20:31:57.833586 23473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.814916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38753 (local address 127.13.149.67:33087)
0806 20:31:57.815619 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0806 20:31:57.815655 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 20:31:57.817481 (+ 1826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:31:57.818184 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:31:57.818191 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:31:57.818778 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:31:57.819393 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:57.819408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.820506 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.820514 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:57.821776 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:31:57.821788 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.822566 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.822573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:31:57.822801 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.823397 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:31:57.823421 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:31:57.825696 (+ 2275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:31:57.829174 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:57.829183 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:57.829197 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:57.829631 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:57.830058 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:31:57.830064 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:31:57.830068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:31:57.830287 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:31:57.830932 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:31:57.830940 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:31:57.831336 (+ 396us) client_negotiation.cc:769] Sending connection context
0806 20:31:57.831671 (+ 335us) client_negotiation.cc:240] Negotiation successful
0806 20:31:57.832199 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":293,"threads_started":1}
I20260806 20:31:57.834882 23471 heartbeater.cc:347] Connected to a master server at 127.13.149.126:38753
I20260806 20:31:57.835161 23471 heartbeater.cc:464] Registering TS with master...
I20260806 20:31:57.835851 23471 heartbeater.cc:511] Master 127.13.149.126:38753 requested a full tablet report, sending...
I20260806 20:31:57.837265 22757 ts_manager.cc:194] Registered new tserver with Master: 3b5b9b1e21194dc5988d2986e3003cbb (127.13.149.67:46493)
I20260806 20:31:57.838042 22757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:33087
I20260806 20:31:57.844933 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/test-admin.keytab.
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.878731 13909 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 20:31:57.884268 23482 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:57.881543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38478 (local address 127.13.149.65:42281)
0806 20:31:57.882333 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.882340 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.882364 (+ 24us) server_negotiation.cc:407] Connection header received
0806 20:31:57.882428 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.882434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.882675 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.882845 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.883784 (+ 939us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38478: BlockingRecv error: recv got EOF from 127.0.0.1:38478 (error 108)
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":383,"threads_started":1}
W20260806 20:31:57.884835 13909 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc)
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.886587 13909 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.887869 13909 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:57.903810 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.889593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38492 (local address 127.13.149.65:42281)
0806 20:31:57.889776 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.889783 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.889908 (+ 125us) server_negotiation.cc:407] Connection header received
0806 20:31:57.890116 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.890120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.890177 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.890276 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.891255 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.892216 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.893523 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.894064 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.894208 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.897833 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:57.897844 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:57.897857 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:57.897888 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:57.900502 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.901451 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.901468 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.901471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.901607 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.902100 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.902110 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.902113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.902510 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:57.902845 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:57.903237 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 20:31:57.903518 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 20:31:57.909225 23482 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:57.907722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38498 (local address 127.13.149.65:42281)
0806 20:31:57.907912 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.907917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.908043 (+ 126us) server_negotiation.cc:407] Connection header received
0806 20:31:57.908155 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.908158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.908207 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.908280 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.908998 (+ 718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38498: BlockingRecv error: recv got EOF from 127.0.0.1:38498 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 20:31:57.909343 13909 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc)
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.910882 13909 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.912129 13909 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:57.925019 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.913311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38508 (local address 127.13.149.65:42281)
0806 20:31:57.913526 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.913531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.913709 (+ 178us) server_negotiation.cc:407] Connection header received
0806 20:31:57.913809 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.913812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.913860 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.913931 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.914766 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.915403 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.916490 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.916967 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.917058 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.920245 (+ 3187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:57.920250 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:57.920253 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:57.920281 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:57.922875 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.923435 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.923439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.923441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.923567 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.923882 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.923885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.923887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.924116 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:57.924306 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:57.924533 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 20:31:57.924720 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260806 20:31:57.929352 23482 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:31:57.927610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38524 (local address 127.13.149.65:42281)
0806 20:31:57.927809 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.927816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.928075 (+ 259us) server_negotiation.cc:407] Connection header received
0806 20:31:57.928246 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.928251 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.928320 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.928416 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.929139 (+ 723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38524: BlockingRecv error: recv got EOF from 127.0.0.1:38524 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260806 20:31:57.929579 13909 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786048265930148-13909-0/krb5kdc/krb5cc' of type FILE
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.930971 13909 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:31:57.932204 13909 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 20:31:57 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:31:57.944726 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.933404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38526 (local address 127.13.149.65:42281)
0806 20:31:57.933546 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.933550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.933860 (+ 310us) server_negotiation.cc:407] Connection header received
0806 20:31:57.933960 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.933963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.934017 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.934090 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.934872 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.935531 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.936635 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.937101 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.937189 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.940358 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:57.940362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:57.940365 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:57.940393 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:57.942716 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.943255 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.943258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.943260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.943394 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.943704 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.943707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.943709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.943934 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:57.944175 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:57.944344 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 20:31:57.944489 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 20:31:57.946131 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 22852
I20260806 20:31:57.957041 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:57.946737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38528 (local address 127.13.149.65:42281)
0806 20:31:57.946918 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:57.946926 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:57.947193 (+ 267us) server_negotiation.cc:407] Connection header received
0806 20:31:57.947305 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:57.947308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:57.947355 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:57.947424 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:57.948266 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.948968 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.950085 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:57.950495 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:57.950621 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:57.952378 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:57.952382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:57.952385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:57.952412 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:57.954813 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.955346 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.955349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.955351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.955466 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:57.955773 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:57.955776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:57.955778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:57.956034 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:57.956248 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:57.956506 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 20:31:57.956732 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:31:57.957633 23056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:58.043367 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 22852
I20260806 20:31:58.067461 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 23072
Aug 06 20:31:58 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:31:58.083359 23504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:58.068652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45754 (local address 127.13.149.66:33141)
0806 20:31:58.069206 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:58.069213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:58.069238 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:31:58.069298 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:58.069305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:58.069513 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:58.069701 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:58.070774 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:58.071826 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:58.073236 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:58.073786 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:58.073929 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:58.077827 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:58.077839 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:58.077854 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:58.077892 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:58.080670 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:58.081448 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:58.081457 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:58.081460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:58.081587 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:58.081956 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:58.081960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:58.081962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:58.082294 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:58.082519 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:58.082814 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 20:31:58.083039 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":292,"threads_started":1}
I20260806 20:31:58.084756 23256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:58.168721 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 23072
I20260806 20:31:58.195554 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 23278
Aug 06 20:31:58 dist-test-slave-2kcd krb5kdc[22680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:31:58.211108 23509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:31:58.196689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58200 (local address 127.13.149.67:46493)
0806 20:31:58.197456 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0806 20:31:58.197463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:31:58.197492 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:31:58.197566 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:31:58.197573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:31:58.197779 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:31:58.197910 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:31:58.198900 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:58.199875 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:58.201326 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:31:58.201869 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:31:58.201968 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:31:58.205784 (+ 3816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:31:58.205794 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:31:58.205809 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:31:58.205840 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:31:58.208718 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:58.209418 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:58.209424 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:58.209427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:58.209561 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:31:58.209871 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:31:58.209874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:31:58.209876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:31:58.210193 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:31:58.210425 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 20:31:58.210622 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 20:31:58.210819 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":464,"threads_started":1}
I20260806 20:31:58.212356 23462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:58.298887 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 23278
I20260806 20:31:58.324421 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 22702
I20260806 20:31:58.325647 22800 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:31:58.429896 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 22702
2026-08-06T20:31:58Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4301 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:31:58 dist-test-slave-2kcd krb5kdc[23520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:31:58 dist-test-slave-2kcd krb5kdc[23520](info): set up 2 sockets
Aug 06 20:31:58 dist-test-slave-2kcd krb5kdc[23520](info): commencing operation
krb5kdc: starting...
W20260806 20:31:59.763144 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.001s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:31:59 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:31:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:31:59Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab.
Entry for principal oryx/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab.
I20260806 20:32:00.000536 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:43615
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab
--principal=oryx/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:43615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:00.333729 23539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:00.333995 23539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:00.334157 23539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:00.341111 23539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:00.341202 23539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:00.341295 23539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:00.341367 23539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:00.341428 23539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:00.350626 23539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:43615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab
--principal=oryx/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:43615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:00.351800 23539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:00.353070 23539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:00.364977 23546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:00.364984 23545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:00.365012 23548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:00.365662 23539 server_base.cc:1034] running on GCE node
I20260806 20:32:00.366421 23539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:00.367779 23539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:00.369014 23539 hybrid_clock.cc:648] HybridClock initialized: now 1786048320368971 us; error 53 us; skew 500 ppm
I20260806 20:32:00.369345 23539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:00 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048320, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:00.372332 23539 init.cc:377] Logged in from keytab as oryx/127.13.149.126@KRBTEST.COM (short username oryx)
I20260806 20:32:00.373867 23539 webserver.cc:460] Webserver started at http://127.13.149.126:39331/ using document root <none> and password file <none>
I20260806 20:32:00.374547 23539 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:00.374714 23539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:00.375025 23539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:00.377877 23539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "b949e33aaac5425e901ceb727dbd030e"
format_stamp: "Formatted at 2026-08-06 20:32:00 on dist-test-slave-2kcd"
server_key: "a55d1230301843b32ce23c2228e699ef"
server_key_iv: "e8c168b4bf8df285e3f96c56cb2a3cef"
server_key_version: "encryptionkey@0"
I20260806 20:32:00.378652 23539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "b949e33aaac5425e901ceb727dbd030e"
format_stamp: "Formatted at 2026-08-06 20:32:00 on dist-test-slave-2kcd"
server_key: "a55d1230301843b32ce23c2228e699ef"
server_key_iv: "e8c168b4bf8df285e3f96c56cb2a3cef"
server_key_version: "encryptionkey@0"
I20260806 20:32:00.383708 23539 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:32:00.386899 23557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:00.388100 23539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 20:32:00.388276 23539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "b949e33aaac5425e901ceb727dbd030e"
format_stamp: "Formatted at 2026-08-06 20:32:00 on dist-test-slave-2kcd"
server_key: "a55d1230301843b32ce23c2228e699ef"
server_key_iv: "e8c168b4bf8df285e3f96c56cb2a3cef"
server_key_version: "encryptionkey@0"
I20260806 20:32:00.388464 23539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:00.420248 23539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:00.424146 23539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:00.424433 23539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:00.442799 23539 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:43615
I20260806 20:32:00.442840 23654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:43615 every 8 connection(s)
I20260806 20:32:00.444149 23539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:32:00.444705 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 23539
I20260806 20:32:00.444947 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:32:00.445777 13909 external_mini_cluster.cc:1428] Setting key 8f77381a1a32699906c8160802ccb3c5
I20260806 20:32:00.448412 23656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:00.458616 23656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: Bootstrap starting.
Aug 06 20:32:00 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:00.461695 23656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:00.463052 23656 log.cc:824] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:00.465885 23656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: No bootstrap required, opened a new log
I20260806 20:32:00.467782 23663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:00.447736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44004 (local address 127.13.149.126:43615)
0806 20:32:00.448501 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:00.448525 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:00.448587 (+ 62us) server_negotiation.cc:407] Connection header received
0806 20:32:00.450214 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:00.450234 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:00.450594 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:00.450990 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:00.452476 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:00.453860 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:00.455120 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:00.455781 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:00.456001 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:00.459968 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:00.459976 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:00.459988 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:00.460030 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:00.463845 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:00.464531 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:00.464539 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:00.464547 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:00.464731 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:00.465166 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:00.465171 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:00.465175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:00.465644 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:00.465982 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:00.466401 (+ 419us) server_negotiation.cc:299] Negotiation successful
0806 20:32:00.466799 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":338,"threads_started":1}
I20260806 20:32:00.475240 23656 raft_consensus.cc:348] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } }
I20260806 20:32:00.475608 23656 raft_consensus.cc:374] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:00.475718 23656 raft_consensus.cc:729] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b949e33aaac5425e901ceb727dbd030e, State: Initialized, Role: FOLLOWER
I20260806 20:32:00.476258 23656 consensus_queue.cc:260] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } }
I20260806 20:32:00.476529 23656 raft_consensus.cc:388] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:32:00.476684 23656 raft_consensus.cc:482] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:32:00.476922 23656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:00.479278 23656 raft_consensus.cc:504] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } }
I20260806 20:32:00.479766 23656 leader_election.cc:302] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b949e33aaac5425e901ceb727dbd030e; no voters:
I20260806 20:32:00.480368 23656 leader_election.cc:288] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:32:00.480517 23666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:00.481287 23666 raft_consensus.cc:686] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 1 LEADER]: Becoming Leader. State: Replica: b949e33aaac5425e901ceb727dbd030e, State: Running, Role: LEADER
I20260806 20:32:00.481796 23666 consensus_queue.cc:237] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } }
I20260806 20:32:00.482506 23656 sys_catalog.cc:564] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:00.484854 23668 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b949e33aaac5425e901ceb727dbd030e. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } }
I20260806 20:32:00.485349 23668 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:00.485250 23667 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } }
I20260806 20:32:00.485591 23667 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:00.497809 23675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:00.502105 23675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:00.509800 23675 catalog_manager.cc:1347] Generated new cluster ID: e9157dd5c9d64ab789e1ac4678fb5c91
I20260806 20:32:00.509905 23675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:00.555284 23675 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:32:00.556731 23675 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:00.565526 23675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: Generated new TSK 0
I20260806 20:32:00.566579 23675 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab.
Entry for principal oryx/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab.
I20260806 20:32:00.622108 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43615
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab
--principal=oryx/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:00.952529 23708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:00.952827 23708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:00.952993 23708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:00.960318 23708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:00.960450 23708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:00.960637 23708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:00.970691 23708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab
--principal=oryx/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:00.971940 23708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:00.973332 23708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:00.986615 23716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:00.986706 23719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:00.986677 23715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:00.988133 23708 server_base.cc:1034] running on GCE node
I20260806 20:32:00.988865 23708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:00.989758 23708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:00.990957 23708 hybrid_clock.cc:648] HybridClock initialized: now 1786048320990911 us; error 43 us; skew 500 ppm
I20260806 20:32:00.991276 23708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:00 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048320, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:00.994767 23708 init.cc:377] Logged in from keytab as oryx/127.13.149.65@KRBTEST.COM (short username oryx)
I20260806 20:32:00.996279 23708 webserver.cc:460] Webserver started at http://127.13.149.65:39169/ using document root <none> and password file <none>
I20260806 20:32:00.996941 23708 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:00.997080 23708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:00.997327 23708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:01.000049 23708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "be8383825f834388951a5ece3f8d1da3"
format_stamp: "Formatted at 2026-08-06 20:32:00 on dist-test-slave-2kcd"
server_key: "79e2832acd3af1d62e493b6215962ec0"
server_key_iv: "4b8d1b9b1d3eab9bf5fb666800c8cd3a"
server_key_version: "encryptionkey@0"
I20260806 20:32:01.000777 23708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "be8383825f834388951a5ece3f8d1da3"
format_stamp: "Formatted at 2026-08-06 20:32:00 on dist-test-slave-2kcd"
server_key: "79e2832acd3af1d62e493b6215962ec0"
server_key_iv: "4b8d1b9b1d3eab9bf5fb666800c8cd3a"
server_key_version: "encryptionkey@0"
I20260806 20:32:01.005657 23708 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 20:32:01.008912 23730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:01.010179 23708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:01.010308 23708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "be8383825f834388951a5ece3f8d1da3"
format_stamp: "Formatted at 2026-08-06 20:32:00 on dist-test-slave-2kcd"
server_key: "79e2832acd3af1d62e493b6215962ec0"
server_key_iv: "4b8d1b9b1d3eab9bf5fb666800c8cd3a"
server_key_version: "encryptionkey@0"
I20260806 20:32:01.010456 23708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:01.035090 23708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:01.039291 23708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:01.039534 23708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:01.040412 23708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:01.041746 23708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:01.041823 23708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:01.041913 23708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:01.041950 23708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:01.076052 23708 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:35643
I20260806 20:32:01.076148 23910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:35643 every 8 connection(s)
I20260806 20:32:01.077425 23708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:01.085933 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 23708
I20260806 20:32:01.086151 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:32:01.086794 13909 external_mini_cluster.cc:1428] Setting key 53c8a900e710dbfc046311483fbc04ea
Aug 06 20:32:01 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048320, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:01.098551 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:01.079865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:37143 (local address 127.13.149.126:43615)
0806 20:32:01.080321 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:01.080326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:01.081202 (+ 876us) server_negotiation.cc:407] Connection header received
0806 20:32:01.083094 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:01.083099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:01.083184 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:01.083307 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:01.084803 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.085599 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.087261 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.087809 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.087966 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:01.091585 (+ 3619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:01.091593 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:01.091600 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:01.091644 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:01.095237 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:01.096036 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:01.096044 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:01.096050 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:01.096204 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:01.096622 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:01.096630 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:01.096636 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:01.097057 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:01.097209 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:01.097809 (+ 600us) server_negotiation.cc:299] Negotiation successful
0806 20:32:01.098063 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":250,"threads_started":1}
I20260806 20:32:01.099063 23915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:01.080287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.65:37143)
0806 20:32:01.081053 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:01.081090 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:01.082808 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:01.083563 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:01.083570 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:01.084082 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:01.084614 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:01.084631 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.085756 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.085760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:01.087106 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:01.087119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.088072 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.088080 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:01.088356 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:01.089167 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:01.089195 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:01.091365 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:01.095414 (+ 4049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:01.095420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:01.095431 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:01.095919 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:01.096317 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:01.096320 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:01.096323 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:01.096512 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:01.097174 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:01.097180 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:01.097451 (+ 271us) client_negotiation.cc:769] Sending connection context
0806 20:32:01.097676 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 20:32:01.098017 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":270,"threads_started":1}
I20260806 20:32:01.100550 23912 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43615
I20260806 20:32:01.100883 23912 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:01.101564 23912 heartbeater.cc:511] Master 127.13.149.126:43615 requested a full tablet report, sending...
I20260806 20:32:01.103570 23592 ts_manager.cc:194] Registered new tserver with Master: be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643)
I20260806 20:32:01.105028 23592 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:37143
WARNING: no policy specified for oryx/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab.
Entry for principal oryx/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab.
I20260806 20:32:01.141510 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43615
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab
--principal=oryx/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:01.468426 23923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:01.468742 23923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:01.468931 23923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:01.477617 23923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:01.477717 23923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:01.477835 23923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:01.487437 23923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab
--principal=oryx/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:01.488747 23923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:01.490386 23923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:01.503945 23933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:01.503887 23931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:01.504153 23930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:01.505033 23923 server_base.cc:1034] running on GCE node
I20260806 20:32:01.505630 23923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:01.506481 23923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:01.507680 23923 hybrid_clock.cc:648] HybridClock initialized: now 1786048321507635 us; error 43 us; skew 500 ppm
I20260806 20:32:01.507990 23923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:01 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048321, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:01.511199 23923 init.cc:377] Logged in from keytab as oryx/127.13.149.66@KRBTEST.COM (short username oryx)
I20260806 20:32:01.512540 23923 webserver.cc:460] Webserver started at http://127.13.149.66:33559/ using document root <none> and password file <none>
I20260806 20:32:01.513247 23923 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:01.513375 23923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:01.513671 23923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:01.516515 23923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "b4ff4778fd75408fbabfd75f01bfa30d"
format_stamp: "Formatted at 2026-08-06 20:32:01 on dist-test-slave-2kcd"
server_key: "7a9571f486b2708acbef35ef5e390e7b"
server_key_iv: "f69d4068aaf59259e150d553137e586b"
server_key_version: "encryptionkey@0"
I20260806 20:32:01.517354 23923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "b4ff4778fd75408fbabfd75f01bfa30d"
format_stamp: "Formatted at 2026-08-06 20:32:01 on dist-test-slave-2kcd"
server_key: "7a9571f486b2708acbef35ef5e390e7b"
server_key_iv: "f69d4068aaf59259e150d553137e586b"
server_key_version: "encryptionkey@0"
I20260806 20:32:01.522258 23923 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:32:01.525511 23943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:01.526762 23923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:32:01.526942 23923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "b4ff4778fd75408fbabfd75f01bfa30d"
format_stamp: "Formatted at 2026-08-06 20:32:01 on dist-test-slave-2kcd"
server_key: "7a9571f486b2708acbef35ef5e390e7b"
server_key_iv: "f69d4068aaf59259e150d553137e586b"
server_key_version: "encryptionkey@0"
I20260806 20:32:01.527123 23923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:01.539254 23923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:01.543488 23923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:01.543799 23923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:01.544725 23923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:01.546108 23923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:01.546185 23923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:01.546351 23923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:01.546407 23923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:01.580730 23923 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:46303
I20260806 20:32:01.580813 24120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:46303 every 8 connection(s)
I20260806 20:32:01.582046 23923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:01.592095 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 23923
I20260806 20:32:01.592288 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:32:01.592928 13909 external_mini_cluster.cc:1428] Setting key 50bf5bdeac985aa0e1c51fc574132451
Aug 06 20:32:01 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048321, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:01.602361 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:01.584754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:57885 (local address 127.13.149.126:43615)
0806 20:32:01.584997 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:01.585004 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:01.586146 (+ 1142us) server_negotiation.cc:407] Connection header received
0806 20:32:01.587866 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:01.587871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:01.587947 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:01.588036 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:01.589496 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.590207 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.591853 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.592367 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.592515 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:01.596349 (+ 3834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:01.596354 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:01.596357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:01.596388 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:01.598956 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:01.599812 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:01.599821 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:01.599827 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:01.600002 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:01.600420 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:01.600428 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:01.600434 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:01.600855 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:01.601009 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:01.601663 (+ 654us) server_negotiation.cc:299] Negotiation successful
0806 20:32:01.601929 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 20:32:01.602962 24123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:01.585295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.66:57885)
0806 20:32:01.585996 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:01.586033 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:01.587620 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:01.588236 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:01.588243 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:01.588751 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:01.589347 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:01.589364 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.590334 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.590338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:01.591691 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:01.591707 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:01.592631 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:01.592639 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:01.592956 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:01.593689 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:01.593711 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:01.596112 (+ 2401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:01.599112 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:01.599120 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:01.599136 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:01.599649 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:01.600120 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:01.600123 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:01.600125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:01.600300 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:01.600978 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:01.600984 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:01.601285 (+ 301us) client_negotiation.cc:769] Sending connection context
0806 20:32:01.601506 (+ 221us) client_negotiation.cc:240] Negotiation successful
0806 20:32:01.601874 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":287,"threads_started":1}
I20260806 20:32:01.604421 24121 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43615
I20260806 20:32:01.604755 24121 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:01.605602 24121 heartbeater.cc:511] Master 127.13.149.126:43615 requested a full tablet report, sending...
I20260806 20:32:01.607110 23592 ts_manager.cc:194] Registered new tserver with Master: b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:01.608379 23592 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:57885
WARNING: no policy specified for oryx/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab.
Entry for principal oryx/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab.
I20260806 20:32:01.648058 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43615
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab
--principal=oryx/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:01.975428 24131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:01.975682 24131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:01.975841 24131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:01.983207 24131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:01.983335 24131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:01.983551 24131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:01.993256 24131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab
--principal=oryx/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:43615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:01.994524 24131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:01.995936 24131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:02.008975 24140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:02.009197 24143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:02.009229 24139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:02.009929 24131 server_base.cc:1034] running on GCE node
I20260806 20:32:02.010499 24131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:02.011332 24131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:02.012531 24131 hybrid_clock.cc:648] HybridClock initialized: now 1786048322012495 us; error 23 us; skew 500 ppm
I20260806 20:32:02.012907 24131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048322, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:02.016180 24131 init.cc:377] Logged in from keytab as oryx/127.13.149.67@KRBTEST.COM (short username oryx)
I20260806 20:32:02.017604 24131 webserver.cc:460] Webserver started at http://127.13.149.67:36429/ using document root <none> and password file <none>
I20260806 20:32:02.018324 24131 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:02.018427 24131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:02.018671 24131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:02.021555 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "78a790cb6a2c4acf8a7e0873a226d545"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "ada5e74152e95d9c7c9f12dee23bb4b6"
server_key_iv: "a0e74c69c1d0d62c7f1d26eb9fd78544"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.022282 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "78a790cb6a2c4acf8a7e0873a226d545"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "ada5e74152e95d9c7c9f12dee23bb4b6"
server_key_iv: "a0e74c69c1d0d62c7f1d26eb9fd78544"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.027348 24131 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:32:02.030932 24154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:02.032390 24131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:02.032559 24131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "78a790cb6a2c4acf8a7e0873a226d545"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "ada5e74152e95d9c7c9f12dee23bb4b6"
server_key_iv: "a0e74c69c1d0d62c7f1d26eb9fd78544"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.032753 24131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:02.055136 24131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:02.059175 24131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:02.059478 24131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:02.060465 24131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:02.061837 24131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:02.061941 24131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:02.062099 24131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:02.062171 24131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:02.097133 24131 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:44933
I20260806 20:32:02.097220 24319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:44933 every 8 connection(s)
I20260806 20:32:02.098417 24131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:02.099677 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 24131
I20260806 20:32:02.099915 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:32:02.100409 13909 external_mini_cluster.cc:1428] Setting key 878fcd6b78c377b656b538f4c8119e9c
I20260806 20:32:02.107687 23912 heartbeater.cc:503] Master 127.13.149.126:43615 was elected leader, sending a full tablet report...
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048322, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:02.119223 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.101203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:43351 (local address 127.13.149.126:43615)
0806 20:32:02.101393 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.101397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.102875 (+ 1478us) server_negotiation.cc:407] Connection header received
0806 20:32:02.104986 (+ 2111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.104992 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.105087 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.105202 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.106677 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.107435 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.109133 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.109568 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.109709 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.113229 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.113234 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.113237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.113269 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.116541 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.117295 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.117299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.117301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.117429 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.117798 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.117801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.117803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.118065 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.118185 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.118813 (+ 628us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.118975 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:32:02.120226 24323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.101796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.67:43351)
0806 20:32:02.102685 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:02.102749 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:02.104637 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:02.105455 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:02.105462 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:02.105956 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:02.106507 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.106524 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.107618 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.107623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.108988 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.109001 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.109800 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.109809 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.110046 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.110748 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:02.110770 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:02.113002 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:02.116664 (+ 3662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.116671 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.116682 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.117185 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.117522 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.117526 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.117528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.117699 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.118171 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:02.118177 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:02.118498 (+ 321us) client_negotiation.cc:769] Sending connection context
0806 20:32:02.118717 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 20:32:02.119100 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":319,"threads_started":1}
I20260806 20:32:02.121652 24320 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43615
I20260806 20:32:02.121969 24320 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:02.122699 24320 heartbeater.cc:511] Master 127.13.149.126:43615 requested a full tablet report, sending...
I20260806 20:32:02.124123 23592 ts_manager.cc:194] Registered new tserver with Master: 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67:44933)
I20260806 20:32:02.124953 23592 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:43351
I20260806 20:32:02.128208 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.149.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.125.keytab.
Entry for principal oryx/127.13.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.125.keytab.
I20260806 20:32:02.185397 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:39387
--webserver_interface=127.13.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.125.keytab
--principal=oryx/127.13.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:43615,127.13.149.125:39387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:02.569605 24326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:02.569895 24326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:02.570077 24326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:02.577531 24326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:02.577639 24326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:02.577769 24326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:02.577867 24326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:02.578015 24326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:02.588670 24326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:43615,127.13.149.125:39387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.125.keytab
--principal=oryx/127.13.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:39387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
W20260806 20:32:02.589093 24326 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.13.149.126:43615,127.13.149.125:39387'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 20:32:02.590121 24326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:02.591517 24326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:02.603544 24332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:02.603498 24334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:02.603590 24336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:02.604535 24326 server_base.cc:1034] running on GCE node
I20260806 20:32:02.605368 24326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:02.606758 24326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:02.608021 24326 hybrid_clock.cc:648] HybridClock initialized: now 1786048322607941 us; error 43 us; skew 500 ppm
I20260806 20:32:02.608422 24326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:02.610886 24121 heartbeater.cc:503] Master 127.13.149.126:43615 was elected leader, sending a full tablet report...
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048322, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:02.611792 24326 init.cc:377] Logged in from keytab as oryx/127.13.149.125@KRBTEST.COM (short username oryx)
I20260806 20:32:02.613518 24326 webserver.cc:460] Webserver started at http://127.13.149.125:42563/ using document root <none> and password file <none>
I20260806 20:32:02.614310 24326 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:02.614444 24326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:02.614780 24326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:02.617835 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/instance:
uuid: "5b89d1565a304103ac5c6df9a68d8963"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "1391600ab4c1c4971ca708ecb21ab726"
server_key_iv: "0c4927436920f29dbd16dca8d0d20319"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.618637 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal/instance:
uuid: "5b89d1565a304103ac5c6df9a68d8963"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "1391600ab4c1c4971ca708ecb21ab726"
server_key_iv: "0c4927436920f29dbd16dca8d0d20319"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.623721 24326 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:32:02.627130 24344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:02.628394 24326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:02.628597 24326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
uuid: "5b89d1565a304103ac5c6df9a68d8963"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "1391600ab4c1c4971ca708ecb21ab726"
server_key_iv: "0c4927436920f29dbd16dca8d0d20319"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.628845 24326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:02.646034 24326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:02.650053 24326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:02.650331 24326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:02.668622 24326 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.125:39387
I20260806 20:32:02.668641 24428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.125:39387 every 8 connection(s)
I20260806 20:32:02.670070 24326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
I20260806 20:32:02.672703 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 24326
I20260806 20:32:02.674062 24429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:02.683671 24429 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.125@KRBTEST.COM
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048322, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.125@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:02.696164 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.675022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35582 (local address 127.13.149.125:39387)
0806 20:32:02.675821 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.675833 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.675871 (+ 38us) server_negotiation.cc:407] Connection header received
0806 20:32:02.677464 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.677485 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.677849 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.678285 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.680127 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.681625 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.682964 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.683733 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.684009 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.688530 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.688541 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.688550 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.688602 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.691586 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.692483 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.692492 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.692501 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.692713 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.693240 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.693245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.693249 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.693913 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.694258 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.694641 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.695018 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":363,"threads_started":1}
I20260806 20:32:02.701663 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.686215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.13.149.126:43615)
0806 20:32:02.686715 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.686722 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.687294 (+ 572us) server_negotiation.cc:407] Connection header received
0806 20:32:02.687478 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.687486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.687582 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.687718 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.688862 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.689784 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.691440 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.691994 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.692130 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.695978 (+ 3848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.695983 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.695986 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.696017 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.698811 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.699531 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.699539 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.699545 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.699690 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.700094 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.700099 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.700102 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.700395 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.700563 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.701061 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.701283 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":243,"threads_started":1}
I20260806 20:32:02.701704 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.686220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44010)
0806 20:32:02.687139 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:02.687186 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:02.687341 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:02.687789 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:02.687795 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:02.688383 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:02.688688 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.688698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.689942 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.689947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.691291 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.691303 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.692209 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.692217 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.692363 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.693074 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:02.693090 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:02.695791 (+ 2701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:02.698969 (+ 3178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.698980 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.698986 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.699395 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.699803 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.699809 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.699812 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.699981 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.700533 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:02.700541 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:02.700707 (+ 166us) client_negotiation.cc:769] Sending connection context
0806 20:32:02.700963 (+ 256us) client_negotiation.cc:240] Negotiation successful
0806 20:32:02.701275 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":534,"threads_started":1}
I20260806 20:32:02.703426 24429 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048322, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.125@KRBTEST.COM for oryx/127.13.149.125@KRBTEST.COM
I20260806 20:32:02.714756 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.703972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.0.0.1:35594)
0806 20:32:02.704126 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:02.704141 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:02.704214 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:02.704474 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:02.704477 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:02.704856 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:02.705004 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.705012 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.705927 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.705930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.706762 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.706772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.707399 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.707403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.707518 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.707968 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:02.707984 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:02.709853 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:02.712607 (+ 2754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.712610 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.712612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.713037 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.713400 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.713403 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.713406 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.713529 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.714018 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:02.714022 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:02.714143 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 20:32:02.714246 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 20:32:02.714522 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 20:32:02.715092 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.704123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.13.149.125:39387)
0806 20:32:02.704263 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.704267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.704280 (+ 13us) server_negotiation.cc:407] Connection header received
0806 20:32:02.704315 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.704318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.704366 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.704439 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.705119 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.705810 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.706879 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.707280 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.707367 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.710014 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.710019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.710022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.710048 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.712487 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.713149 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.713153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.713155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.713283 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.713631 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.713635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.713637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.713906 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.714019 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.714376 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.714671 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":48}
I20260806 20:32:02.719627 24429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Bootstrap starting.
I20260806 20:32:02.722790 24429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:02.723825 24429 log.cc:824] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:02.726555 24429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: No bootstrap required, opened a new log
I20260806 20:32:02.734031 24429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } }
I20260806 20:32:02.734359 24429 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:02.734470 24429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b89d1565a304103ac5c6df9a68d8963, State: Initialized, Role: FOLLOWER
I20260806 20:32:02.735028 24429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } }
I20260806 20:32:02.735898 24439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } } }
I20260806 20:32:02.736184 24439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:32:02.737058 24429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 20:32:02.745976 24460 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:32:02.746111 24460 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:32:02.748152 24326 master_runner.cc:428] Detected that this master 5b89d1565a304103ac5c6df9a68d8963 is joining an existing cluster
I20260806 20:32:02.748261 24326 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.149.125:39387
I20260806 20:32:02.770002 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.752262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.13.149.126:43615)
0806 20:32:02.752476 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.752485 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.753410 (+ 925us) server_negotiation.cc:407] Connection header received
0806 20:32:02.753712 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.753717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.753803 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.753878 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.755743 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.757255 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.759925 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.760606 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.760702 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.763462 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.763467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.763470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.763502 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.766357 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.767147 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.767153 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.767156 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.767312 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.767808 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.767813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.767817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.768194 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.768324 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.769068 (+ 744us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.769321 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:32:02.771171 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.752286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44016)
0806 20:32:02.753307 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:02.753328 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:02.753541 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:02.754165 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:02.754172 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:02.755022 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:02.755528 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.755543 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.757491 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.757499 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.759720 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.759738 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.761011 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.761018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.761212 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.762100 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:02.762125 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:02.763269 (+ 1144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:02.766495 (+ 3226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.766511 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.766517 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.767002 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.767461 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.767465 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.767469 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.767661 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.768425 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:02.768430 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:02.768681 (+ 251us) client_negotiation.cc:769] Sending connection context
0806 20:32:02.770273 (+ 1592us) client_negotiation.cc:240] Negotiation successful
0806 20:32:02.770648 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"thread_start_us":712,"threads_started":1}
I20260806 20:32:02.779362 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.753551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35602 (local address 127.13.149.125:39387)
0806 20:32:02.753732 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.753737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.760517 (+ 6780us) server_negotiation.cc:407] Connection header received
0806 20:32:02.761191 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.761196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.761261 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.761330 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.763016 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.764116 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.768096 (+ 3980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.768898 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.768995 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.772116 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.772122 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.772126 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.772159 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.775948 (+ 3789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.776868 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.776873 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.776876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.777045 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.777472 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.777477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.777480 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.777834 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.777988 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.778747 (+ 759us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.778964 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
WARNING: no policy specified for oryx/127.13.149.124@KRBTEST.COM; defaulting to no policy
I20260806 20:32:02.781055 24467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.753842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.0.0.1:35602)
0806 20:32:02.760427 (+ 6585us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:02.760446 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:02.760711 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:02.761525 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:02.761530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:02.762438 (+ 908us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:02.762836 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.762854 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.764339 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.764345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.767944 (+ 3599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.767958 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.769289 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.769295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.769452 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.770062 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:02.770399 (+ 337us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:02.771922 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:02.776116 (+ 4194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.776120 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.776123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.776696 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.777175 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.777178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.777181 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.777351 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.778071 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:02.778075 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:02.778205 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 20:32:02.779974 (+ 1769us) client_negotiation.cc:240] Negotiation successful
0806 20:32:02.780342 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6446,"thread_start_us":6673,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.124@KRBTEST.COM" created.
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048320, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.126@KRBTEST.COM for oryx/127.13.149.125@KRBTEST.COM
I20260806 20:32:02.796650 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.778989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.0.0.1:35608)
0806 20:32:02.781813 (+ 2824us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:02.781866 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:02.782097 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:02.782595 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:02.782603 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:02.783560 (+ 957us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:02.783869 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.783883 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.785280 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.785284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.786246 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.786258 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.787075 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.787082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.787268 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.787882 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:02.787899 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:02.790098 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:02.793456 (+ 3358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.793468 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.793475 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.793993 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.794442 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.794449 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.794453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.794682 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.795371 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:02.795379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:02.795599 (+ 220us) client_negotiation.cc:769] Sending connection context
0806 20:32:02.795875 (+ 276us) client_negotiation.cc:240] Negotiation successful
0806 20:32:02.796207 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2561,"thread_start_us":2514,"threads_started":1}
I20260806 20:32:02.797148 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.779462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35608 (local address 127.13.149.125:39387)
0806 20:32:02.779932 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.779940 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.781954 (+ 2014us) server_negotiation.cc:407] Connection header received
0806 20:32:02.782348 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.782353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.782431 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.782544 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.784054 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.785125 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.786420 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.786904 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.787042 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.790282 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.790287 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.790290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.790318 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.793325 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.794133 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.794139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.794143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.794312 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.794805 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.794810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.794813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.795140 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.795291 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.796024 (+ 733us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.796278 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":1638,"threads_started":1}
I20260806 20:32:02.799216 23592 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.149.125:39387: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963"
member_type: NON_VOTER
last_known_addr {
host: "127.13.149.125"
port: 39387
}
attrs {
promote: true
}
}
dest_uuid: "b949e33aaac5425e901ceb727dbd030e"
cas_config_opid_index: -1
I20260806 20:32:02.800483 23592 consensus_queue.cc:237] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } }
I20260806 20:32:02.815081 24479 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:02.817617 24387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:02.819635 24479 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.149.125:39387
I20260806 20:32:02.821805 24387 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Refusing update from remote peer b949e33aaac5425e901ceb727dbd030e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 20:32:02.821866 24326 master.cc:537] Master@127.13.149.125:39387 shutting down...
I20260806 20:32:02.822995 24479 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.124.keytab.
Entry for principal oryx/127.13.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.124.keytab.
I20260806 20:32:02.821595 24478 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:02.825627 24478 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
W20260806 20:32:02.826545 23565 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260806 20:32:02.827356 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:43345
--webserver_interface=127.13.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.124.keytab
--principal=oryx/127.13.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:02.829394 23565 consensus_peers.cc:487] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e -> Peer 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125:39387): Couldn't send request to peer 5b89d1565a304103ac5c6df9a68d8963. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 20:32:02.840667 24326 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:02.841120 24326 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:02.841279 24326 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: stopping tablet replica
I20260806 20:32:02.857437 24326 master.cc:552] Master@127.13.149.125:39387 shutdown complete.
I20260806 20:32:02.857637 24326 master_runner.cc:305] Clearing existing system tablet
I20260806 20:32:02.858098 24326 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:02.858219 24326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:02.860608 24326 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260806 20:32:02.862224 24486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:02.862587 24326 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:02.862895 24326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 20:32:02.862993 24326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
uuid: "5b89d1565a304103ac5c6df9a68d8963"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "1391600ab4c1c4971ca708ecb21ab726"
server_key_iv: "0c4927436920f29dbd16dca8d0d20319"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.866405 24326 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:02.871117 24326 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 20:32:02.871299 24326 log.cc:1196] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 20:32:02.871717 24326 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Deleting consensus metadata
I20260806 20:32:02.872032 24326 master_runner.cc:315] Copying system tablet from 127.13.149.126:43615
I20260806 20:32:02.874502 24326 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: tablet copy: Beginning tablet copy session from remote peer at address 127.13.149.126:43615
I20260806 20:32:02.887702 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.875288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.13.149.126:43615)
0806 20:32:02.875548 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:02.875557 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:02.876070 (+ 513us) server_negotiation.cc:407] Connection header received
0806 20:32:02.876304 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:02.876314 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:02.876381 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:02.876491 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:02.877425 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.878196 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.879547 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.880015 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.880155 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.882157 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:02.882163 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:02.882174 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:02.882207 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:02.885030 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.885662 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.885669 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.885673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.885807 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:02.886210 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:02.886216 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:02.886220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:02.886497 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:02.886659 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:02.887079 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 20:32:02.887308 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 20:32:02.887811 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:02.875238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44024)
0806 20:32:02.875949 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:02.875966 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:02.876147 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:02.876515 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:02.876521 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:02.877042 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:02.877269 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.877277 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.878351 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.878356 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.879390 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:02.879409 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:02.880167 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:02.880172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:02.880348 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:02.881080 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:02.881097 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:02.881805 (+ 708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:02.885164 (+ 3359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.885170 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.885174 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.885542 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.885928 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:02.885933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:02.885936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:02.886081 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:02.886625 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:02.886629 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:02.886802 (+ 173us) client_negotiation.cc:769] Sending connection context
0806 20:32:02.886972 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 20:32:02.887301 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":461,"threads_started":1}
I20260806 20:32:02.888957 23631 tablet_copy_service.cc:140] P b949e33aaac5425e901ceb727dbd030e: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5b89d1565a304103ac5c6df9a68d8963 ({username='oryx', principal='oryx/127.13.149.125@KRBTEST.COM'} at 127.0.0.1:44024)
I20260806 20:32:02.889230 23631 tablet_copy_service.cc:161] P b949e33aaac5425e901ceb727dbd030e: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5b89d1565a304103ac5c6df9a68d8963 at {username='oryx', principal='oryx/127.13.149.125@KRBTEST.COM'} at 127.0.0.1:44024: session id = 5b89d1565a304103ac5c6df9a68d8963-00000000000000000000000000000000
I20260806 20:32:02.892513 23631 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 20:32:02.894497 24326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 20:32:02.899319 24326 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: tablet copy: Starting download of 0 data blocks...
I20260806 20:32:02.899637 24326 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: tablet copy: Starting download of 1 WAL segments...
I20260806 20:32:02.902312 24326 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 20:32:02.905542 23631 tablet_copy_service.cc:342] P b949e33aaac5425e901ceb727dbd030e: Request end of tablet copy session 5b89d1565a304103ac5c6df9a68d8963-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.149.125@KRBTEST.COM'} at 127.0.0.1:44024
I20260806 20:32:02.905745 23631 tablet_copy_service.cc:433] P b949e33aaac5425e901ceb727dbd030e: ending tablet copy session 5b89d1565a304103ac5c6df9a68d8963-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5b89d1565a304103ac5c6df9a68d8963
I20260806 20:32:02.915768 24326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:02.918385 24505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:02.922242 24506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:02.929579 24508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:02.930431 24326 server_base.cc:1034] running on GCE node
I20260806 20:32:02.930881 24326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:02.931833 24326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:02.933063 24326 hybrid_clock.cc:648] HybridClock initialized: now 1786048322932980 us; error 59 us; skew 500 ppm
I20260806 20:32:02.933295 24326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:02 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048322, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:02.935256 24326 init.cc:377] Logged in from keytab as oryx/127.13.149.125@KRBTEST.COM (short username oryx)
I20260806 20:32:02.936700 24326 webserver.cc:460] Webserver started at http://127.13.149.125:34013/ using document root <none> and password file <none>
I20260806 20:32:02.937126 24326 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:02.937212 24326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:02.939757 24326 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 20:32:02.941504 24517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:02.941951 24326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 20:32:02.942106 24326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
uuid: "5b89d1565a304103ac5c6df9a68d8963"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "1391600ab4c1c4971ca708ecb21ab726"
server_key_iv: "0c4927436920f29dbd16dca8d0d20319"
server_key_version: "encryptionkey@0"
I20260806 20:32:02.942279 24326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:02.952426 24326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:02.956027 24326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:02.981608 24326 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.125:39387
I20260806 20:32:02.981631 24616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.125:39387 every 8 connection(s)
I20260806 20:32:02.982703 24326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
I20260806 20:32:02.989851 24620 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:32:02.992564 24620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Bootstrap starting.
I20260806 20:32:03.006417 24620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:32:03.006883 24620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: Bootstrap complete.
I20260806 20:32:03.007735 24620 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } }
I20260806 20:32:03.007985 24620 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b89d1565a304103ac5c6df9a68d8963, State: Initialized, Role: LEARNER
I20260806 20:32:03.008219 24620 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } }
I20260806 20:32:03.009117 24624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:03.009406 24620 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:03.009523 24624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: LEARNER
I20260806 20:32:03.021725 24637 catalog_manager.cc:1259] Loaded cluster ID: e9157dd5c9d64ab789e1ac4678fb5c91
I20260806 20:32:03.021842 24637 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: loading cluster ID for follower catalog manager: success
I20260806 20:32:03.024122 24637 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: acquiring CA information for follower catalog manager: success
I20260806 20:32:03.026029 24637 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 20:32:03.127447 24320 heartbeater.cc:503] Master 127.13.149.126:43615 was elected leader, sending a full tablet report...
I20260806 20:32:03.221067 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.210575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.0.0.1:35624)
0806 20:32:03.210896 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.210917 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.211050 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.213891 (+ 2841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.213896 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.213931 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:03.214138 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.214150 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.216166 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.216172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.218295 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.218311 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.220187 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.220195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.220434 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.220504 (+ 70us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.220606 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.220756 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154}
I20260806 20:32:03.221583 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.210754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35624 (local address 127.13.149.125:39387)
0806 20:32:03.213388 (+ 2634us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.213396 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.213450 (+ 54us) server_negotiation.cc:407] Connection header received
0806 20:32:03.213538 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.213544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.213648 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.213786 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:03.214322 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.215988 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.218485 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.219971 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.220200 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.220419 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.220659 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.220849 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2456,"thread_start_us":2223,"threads_started":1}
I20260806 20:32:03.223171 24575 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260806 20:32:03.223963 24624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b949e33aaac5425e901ceb727dbd030e. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:03.224268 24624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: LEARNER
W20260806 20:32:03.249549 24484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:03.249925 24484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:03.250083 24484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:03.257500 24484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:03.257645 24484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:03.257752 24484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:03.257860 24484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:03.257938 24484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:03.268250 24484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.124.keytab
--principal=oryx/127.13.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:43345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:03.269766 24484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:03.271116 24484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:03.283469 24647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:03.283529 24650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:03.283485 24656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:03.284335 24484 server_base.cc:1034] running on GCE node
I20260806 20:32:03.285116 24484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:03.286425 24484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:03.287653 24484 hybrid_clock.cc:648] HybridClock initialized: now 1786048323287606 us; error 53 us; skew 500 ppm
I20260806 20:32:03.288007 24484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048323, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:03.291239 24484 init.cc:377] Logged in from keytab as oryx/127.13.149.124@KRBTEST.COM (short username oryx)
I20260806 20:32:03.292900 24484 webserver.cc:460] Webserver started at http://127.13.149.124:39597/ using document root <none> and password file <none>
I20260806 20:32:03.293632 24484 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:03.293778 24484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:03.294096 24484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:03.297376 24484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/instance:
uuid: "4d2cdce5ab014334affbbb67c35c9ab7"
format_stamp: "Formatted at 2026-08-06 20:32:03 on dist-test-slave-2kcd"
server_key: "49589219f345682a6fcfc25aa49c7fcb"
server_key_iv: "06118c56fbe080cdfe413f0d12e21ea5"
server_key_version: "encryptionkey@0"
I20260806 20:32:03.298148 24484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal/instance:
uuid: "4d2cdce5ab014334affbbb67c35c9ab7"
format_stamp: "Formatted at 2026-08-06 20:32:03 on dist-test-slave-2kcd"
server_key: "49589219f345682a6fcfc25aa49c7fcb"
server_key_iv: "06118c56fbe080cdfe413f0d12e21ea5"
server_key_version: "encryptionkey@0"
I20260806 20:32:03.303260 24484 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:32:03.306594 24665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:03.307931 24484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:03.308130 24484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
uuid: "4d2cdce5ab014334affbbb67c35c9ab7"
format_stamp: "Formatted at 2026-08-06 20:32:03 on dist-test-slave-2kcd"
server_key: "49589219f345682a6fcfc25aa49c7fcb"
server_key_iv: "06118c56fbe080cdfe413f0d12e21ea5"
server_key_version: "encryptionkey@0"
I20260806 20:32:03.308350 24484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:03.327397 24484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:03.331769 24484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:03.332089 24484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:03.351624 24484 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.124:43345
I20260806 20:32:03.351688 24759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.124:43345 every 8 connection(s)
I20260806 20:32:03.353125 24484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
I20260806 20:32:03.357066 24760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:03.360680 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 24484
I20260806 20:32:03.364892 24760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.124@KRBTEST.COM
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048323, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.124@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:03.383781 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.367952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44040 (local address 127.13.149.126:43615)
0806 20:32:03.368170 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.368175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.368716 (+ 541us) server_negotiation.cc:407] Connection header received
0806 20:32:03.369015 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.369019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.369085 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.369169 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.370558 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.371628 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.373673 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.374092 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.374224 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.378031 (+ 3807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.378036 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.378039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.378071 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.380664 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.381430 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.381433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.381436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.381607 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.381987 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.381994 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.381998 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.382273 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.382385 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.383040 (+ 655us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.383301 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 20:32:03.384964 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.363131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57154 (local address 127.13.149.124:43345)
0806 20:32:03.363868 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.363880 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.363920 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:32:03.365614 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.365636 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.366032 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.366408 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.367931 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.370099 (+ 2168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.371901 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.373045 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.373222 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.377690 (+ 4468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.377701 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.377717 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.377759 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.380642 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.381332 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.381343 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.381349 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.381527 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.382002 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.382005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.382007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.382626 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.382937 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.383304 (+ 367us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.383566 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":552,"spinlock_wait_cycles":18304,"thread_start_us":347,"threads_started":1}
I20260806 20:32:03.384997 24771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.367829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44040)
0806 20:32:03.368536 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.368592 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.368768 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.369256 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.369263 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.370078 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.370409 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.370418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.371776 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.371779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.373529 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.373539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.374321 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.374329 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.374477 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.375095 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.375115 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.377841 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.380847 (+ 3006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.380857 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.380869 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.381304 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.381716 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.381719 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.381721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.381863 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.382399 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.382407 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.382629 (+ 222us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.382933 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.383460 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":56,"thread_start_us":283,"threads_started":1}
I20260806 20:32:03.387315 24760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048323, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.124@KRBTEST.COM for oryx/127.13.149.125@KRBTEST.COM
I20260806 20:32:03.399915 24771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.387974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.0.0.1:35640)
0806 20:32:03.388129 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.388144 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.388218 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.388667 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.388671 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.389033 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.389170 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.389177 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.390176 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.390183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.391113 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.391123 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.391801 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.391806 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.392060 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.392580 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.392596 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.394624 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.397587 (+ 2963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.397592 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.397596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.397953 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.398320 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.398325 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.398329 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.398463 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.398960 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.398964 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.399121 (+ 157us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.399257 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.399546 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 20:32:03.399935 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.388185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35640 (local address 127.13.149.125:39387)
0806 20:32:03.388396 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.388401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.388415 (+ 14us) server_negotiation.cc:407] Connection header received
0806 20:32:03.388461 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.388465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.388523 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.388647 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.389318 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.390046 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.391251 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.391659 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.391793 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.394823 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.394827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.394831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.394860 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.397449 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.398076 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.398083 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.398087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.398208 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.398574 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.398579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.398583 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.398843 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.398994 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.399353 (+ 359us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.399565 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:32:03.401177 24760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048323, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.124@KRBTEST.COM for oryx/127.13.149.124@KRBTEST.COM
I20260806 20:32:03.412956 24771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.401791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.0.0.1:57170)
0806 20:32:03.401891 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.401904 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.401989 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.402339 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.402342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.402655 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.402787 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.402794 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.403683 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.403686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.404593 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.404604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.405316 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.405320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.405486 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.405962 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.405977 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.407817 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.410700 (+ 2883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.410703 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.410706 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.411060 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.411379 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.411382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.411385 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.411532 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.412096 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.412099 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.412242 (+ 143us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.412356 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.412574 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 20:32:03.413190 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.401968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57170 (local address 127.13.149.124:43345)
0806 20:32:03.402126 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.402131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.402145 (+ 14us) server_negotiation.cc:407] Connection header received
0806 20:32:03.402181 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.402184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.402232 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.402309 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.402901 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.403579 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.404716 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.405194 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.405290 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.407983 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.407988 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.407991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.408017 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.410572 (+ 2555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.411156 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.411160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.411162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.411288 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.411663 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.411667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.411669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.411974 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.412127 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.412449 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.412724 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":84,"server-negotiator.queue_time_us":51}
I20260806 20:32:03.417784 24760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Bootstrap starting.
I20260806 20:32:03.421015 24760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:03.422055 24760 log.cc:824] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:03.424770 24760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: No bootstrap required, opened a new log
I20260806 20:32:03.432211 24760 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } }
I20260806 20:32:03.432571 24760 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:03.432711 24760 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2cdce5ab014334affbbb67c35c9ab7, State: Initialized, Role: FOLLOWER
I20260806 20:32:03.433274 24760 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } }
I20260806 20:32:03.434134 24777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } } }
I20260806 20:32:03.434440 24777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:32:03.435137 24760 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 20:32:03.444844 24798 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:32:03.444988 24798 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:32:03.449306 24777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:03.449460 24484 master_runner.cc:428] Detected that this master 4d2cdce5ab014334affbbb67c35c9ab7 is joining an existing cluster
I20260806 20:32:03.449573 24484 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.149.124:43345
I20260806 20:32:03.449635 24777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } }
I20260806 20:32:03.451208 24777 leader_election.cc:288] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615), 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125:39387)
I20260806 20:32:03.451736 24575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b89d1565a304103ac5c6df9a68d8963" is_pre_election: true
I20260806 20:32:03.452045 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b949e33aaac5425e901ceb727dbd030e" is_pre_election: true
I20260806 20:32:03.453114 24669 leader_election.cc:302] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d2cdce5ab014334affbbb67c35c9ab7; no voters: 5b89d1565a304103ac5c6df9a68d8963, b949e33aaac5425e901ceb727dbd030e
I20260806 20:32:03.453914 24777 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 20:32:03.473719 24639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.456860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35650 (local address 127.13.149.125:39387)
0806 20:32:03.457055 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.457060 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.457653 (+ 593us) server_negotiation.cc:407] Connection header received
0806 20:32:03.457909 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.457914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.457986 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.458070 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.459510 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.460502 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.463193 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.463847 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.463952 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.466533 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.466540 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.466545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.466582 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.470373 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.471253 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.471258 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.471262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.471404 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.471905 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.471912 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.471917 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.472289 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.472417 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.473063 (+ 646us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.473313 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 20:32:03.474638 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.455702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.13.149.126:43615)
0806 20:32:03.455862 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.455867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.456586 (+ 719us) server_negotiation.cc:407] Connection header received
0806 20:32:03.456861 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.456867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.456952 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.457025 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.458764 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.459949 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.462594 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.463285 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.463392 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.466233 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.466240 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.466245 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.466283 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.470316 (+ 4033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.471305 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.471322 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.471326 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.471507 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.472062 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.472068 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.472071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.472471 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.472628 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.473668 (+ 1040us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.474208 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 20:32:03.477677 24807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.455839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44056)
0806 20:32:03.456464 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.456483 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.456659 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.457291 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.457298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.458070 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.458559 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.458578 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.460375 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.460380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.462422 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.462438 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.463633 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.463640 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.463811 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.464588 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.464613 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.466013 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.470495 (+ 4482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.470501 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.470505 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.471143 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.471659 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.471664 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.471667 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.471890 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.472705 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.472710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.473002 (+ 292us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.473170 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.476921 (+ 3751us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":20,"spinlock_wait_cycles":1280,"thread_start_us":369,"threads_started":1}
I20260806 20:32:03.478780 24808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.456861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.0.0.1:35650)
0806 20:32:03.457543 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.457563 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.457758 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.458305 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.458311 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.459015 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.459339 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.459350 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.460717 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.460727 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.463034 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.463048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.464257 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.464265 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.464488 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.465173 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.465198 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.466300 (+ 1102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.470537 (+ 4237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.470542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.470546 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.471125 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.471547 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.471551 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.471554 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.471754 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.472494 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.472499 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.472728 (+ 229us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.473899 (+ 1171us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.477216 (+ 3317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":2893,"spinlock_wait_cycles":2816,"thread_start_us":361,"threads_started":1}
I20260806 20:32:03.484069 24810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.457986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.0.0.1:57180)
0806 20:32:03.468666 (+ 10680us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.468691 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.468880 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.469352 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.469356 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.470038 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.470424 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.470438 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.471885 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.471889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.473470 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.473489 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.474605 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.474609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.474872 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.475454 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.475469 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.476185 (+ 716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.480541 (+ 4356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.480546 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.480550 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.481110 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.481609 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.481613 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.481617 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.481761 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.482627 (+ 866us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.482632 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.482816 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.483031 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.483436 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10483,"thread_start_us":10288,"threads_started":1}
I20260806 20:32:03.484093 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.457676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57180 (local address 127.13.149.124:43345)
0806 20:32:03.457863 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.457869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.468770 (+ 10901us) server_negotiation.cc:407] Connection header received
0806 20:32:03.469024 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.469031 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.469105 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.469169 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.470556 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.471648 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.473643 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.474246 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.474314 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.476400 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.476407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.476412 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.476449 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.480381 (+ 3932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.481259 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.481265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.481269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.481452 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.481880 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.481885 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.481888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.482390 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.482535 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.483165 (+ 630us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.483633 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":197,"server-negotiator.queue_time_us":78}
I20260806 20:32:03.490832 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 23708
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048320, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.126@KRBTEST.COM for oryx/127.13.149.124@KRBTEST.COM
I20260806 20:32:03.500722 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.485197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.0.0.1:57190)
0806 20:32:03.485680 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.485701 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.485828 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.486318 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.486326 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.486714 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.486852 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.486860 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.487827 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.487833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.488701 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.488711 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.489623 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.489629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.489802 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.490474 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.490501 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.493622 (+ 3121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.498001 (+ 4379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.498014 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.498019 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.498514 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.498965 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.498971 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.498977 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.499165 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.499846 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.499852 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.499998 (+ 146us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.500111 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.500384 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361}
I20260806 20:32:03.501785 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.485474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57190 (local address 127.13.149.124:43345)
0806 20:32:03.485644 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.485649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.485783 (+ 134us) server_negotiation.cc:407] Connection header received
0806 20:32:03.486113 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.486116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.486177 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.486292 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.487014 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.487694 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.488862 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.489457 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.489611 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.493806 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.493810 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.493813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.493841 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.497834 (+ 3993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.498659 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.498665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.498669 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.498827 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.499312 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.499317 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.499320 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.499701 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.501156 (+ 1455us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.501271 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.501432 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 20:32:03.503142 23592 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.149.124:43345: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7"
member_type: NON_VOTER
last_known_addr {
host: "127.13.149.124"
port: 43345
}
attrs {
promote: true
}
}
dest_uuid: "b949e33aaac5425e901ceb727dbd030e"
cas_config_opid_index: 5
I20260806 20:32:03.504122 23592 consensus_queue.cc:237] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.65@KRBTEST.COM
I20260806 20:32:03.506105 24478 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.507444 24715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:03.507957 24575 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 LEARNER]: Refusing update from remote peer b949e33aaac5425e901ceb727dbd030e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 20:32:03.508669 24814 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 20:32:03.510066 24478 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.149.124:43345
I20260806 20:32:03.514622 24715 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Refusing update from remote peer b949e33aaac5425e901ceb727dbd030e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 20:32:03.519106 24812 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:03.521654 24814 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.522012 24814 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:03.522116 24811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.491934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39468 (local address 127.13.149.65:35643)
0806 20:32:03.492627 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.492637 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.492674 (+ 37us) server_negotiation.cc:407] Connection header received
0806 20:32:03.492760 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.492771 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.494085 (+ 1314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.494292 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.496069 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.497149 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.498720 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.499574 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.499704 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.505925 (+ 6221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.505941 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.505961 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.506006 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.516366 (+ 10360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.518047 (+ 1681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.518060 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.518066 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.518225 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.519368 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.519372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.519375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.519925 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.521439 (+ 1514us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.521575 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.521769 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":709,"threads_started":1}
I20260806 20:32:03.520439 24575 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.523383 23906 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:03.528692 24624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.528997 24624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: LEARNER
I20260806 20:32:03.529856 24814 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: attempting to promote NON_VOTER 5b89d1565a304103ac5c6df9a68d8963 to VOTER
I20260806 20:32:03.530792 24814 consensus_queue.cc:237] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
I20260806 20:32:03.532948 24714 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Refusing update from remote peer b949e33aaac5425e901ceb727dbd030e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 20:32:03.533344 24575 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 LEARNER]: Refusing update from remote peer b949e33aaac5425e901ceb727dbd030e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 20:32:03.533912 24478 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:03.535274 24478 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 20:32:03.537186 24484 master.cc:537] Master@127.13.149.124:43345 shutting down...
I20260806 20:32:03.544917 24574 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.549167 24478 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.553108 24478 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.553980 24478 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:03.554128 24624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.553458 24814 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.554368 24624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:32:03.554490 24814 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:03.566430 24715 raft_consensus.cc:858] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
W20260806 20:32:03.566607 24715 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
I20260806 20:32:03.581561 24715 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:03.587698 24777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b949e33aaac5425e901ceb727dbd030e. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:03.587946 24777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 20:32:03.587707 24825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:03.588119 24825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 20:32:03.588193 24714 raft_consensus.cc:1467] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20260806 20:32:03.587325 24830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } }
I20260806 20:32:03.588440 24714 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 NON_PARTICIPANT]: Deduplicated request from leader. Original: 0.0->[1.1-1.7] Dedup: 1.5->[1.6-1.7]
I20260806 20:32:03.588593 24830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 20:32:03.589269 24714 raft_consensus.cc:858] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } }.
Pending config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }:
New config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
W20260806 20:32:03.589401 24714 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Could not prepare op 'term: 1 index: 7' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } }.
Pending config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }:
New config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
I20260806 20:32:03.589736 24714 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.593571 24830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: NON_VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: true } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.595105 24830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: LEARNER
I20260806 20:32:03.595507 24478 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.595799 24478 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:03.597559 24484 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Raft consensus shutting down.
I20260806 20:32:03.598048 24484 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Raft consensus is shut down!
I20260806 20:32:03.598220 24484 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: stopping tablet replica
W20260806 20:32:03.598362 23565 consensus_peers.cc:487] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e -> Peer 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124:43345): Couldn't send request to peer 4d2cdce5ab014334affbbb67c35c9ab7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 20:32:03.606184 24484 master.cc:552] Master@127.13.149.124:43345 shutdown complete.
I20260806 20:32:03.606431 24484 master_runner.cc:305] Clearing existing system tablet
I20260806 20:32:03.606853 24484 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:03.607026 24484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:03.610131 24484 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 20:32:03.611752 24833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:03.612149 24484 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:03.612411 24484 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 20:32:03.612514 24484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
uuid: "4d2cdce5ab014334affbbb67c35c9ab7"
format_stamp: "Formatted at 2026-08-06 20:32:03 on dist-test-slave-2kcd"
server_key: "49589219f345682a6fcfc25aa49c7fcb"
server_key_iv: "06118c56fbe080cdfe413f0d12e21ea5"
server_key_version: "encryptionkey@0"
I20260806 20:32:03.617949 24484 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:03.624537 24484 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 20:32:03.624697 24484 log.cc:1196] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 20:32:03.625239 24484 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Deleting consensus metadata
I20260806 20:32:03.625506 24484 master_runner.cc:315] Copying system tablet from 127.13.149.126:43615
I20260806 20:32:03.630566 24484 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: tablet copy: Beginning tablet copy session from remote peer at address 127.13.149.126:43615
I20260806 20:32:03.646754 24843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.631298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44058)
0806 20:32:03.632060 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:03.632088 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:03.632253 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:03.632621 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:03.632626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:03.633326 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:03.633601 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.633615 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.635088 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.635093 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.636844 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:03.636860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.637863 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.637869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:03.638069 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.638734 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:03.638754 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:03.639750 (+ 996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:03.643802 (+ 4052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.643807 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.643812 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.644351 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.644773 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:03.644778 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:03.644782 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:03.645038 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:03.645663 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:03.645668 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:03.645865 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 20:32:03.646020 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 20:32:03.646335 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":495,"threads_started":1}
I20260806 20:32:03.646765 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:03.631388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.13.149.126:43615)
0806 20:32:03.631638 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:03.631644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:03.632191 (+ 547us) server_negotiation.cc:407] Connection header received
0806 20:32:03.632386 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:03.632392 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:03.632475 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:03.632582 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:03.633761 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.634928 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.636997 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:03.637695 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:03.637812 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:03.639952 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:03.639958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:03.639963 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:03.640001 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:03.643659 (+ 3658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.644475 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.644480 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.644483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.644633 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:03.645156 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:03.645162 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:03.645166 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:03.645528 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:03.645688 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:03.646155 (+ 467us) server_negotiation.cc:299] Negotiation successful
0806 20:32:03.646420 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260806 20:32:03.647918 23631 tablet_copy_service.cc:140] P b949e33aaac5425e901ceb727dbd030e: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4d2cdce5ab014334affbbb67c35c9ab7 ({username='oryx', principal='oryx/127.13.149.124@KRBTEST.COM'} at 127.0.0.1:44058)
I20260806 20:32:03.648097 23631 tablet_copy_service.cc:161] P b949e33aaac5425e901ceb727dbd030e: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4d2cdce5ab014334affbbb67c35c9ab7 at {username='oryx', principal='oryx/127.13.149.124@KRBTEST.COM'} at 127.0.0.1:44058: session id = 4d2cdce5ab014334affbbb67c35c9ab7-00000000000000000000000000000000
I20260806 20:32:03.652034 23631 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 20:32:03.652828 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 23708
I20260806 20:32:03.654232 24484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 20:32:03.662128 24484 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: tablet copy: Starting download of 0 data blocks...
I20260806 20:32:03.662432 24484 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: tablet copy: Starting download of 1 WAL segments...
I20260806 20:32:03.664628 24484 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 20:32:03.668741 23631 tablet_copy_service.cc:342] P b949e33aaac5425e901ceb727dbd030e: Request end of tablet copy session 4d2cdce5ab014334affbbb67c35c9ab7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.149.124@KRBTEST.COM'} at 127.0.0.1:44058
I20260806 20:32:03.668998 23631 tablet_copy_service.cc:433] P b949e33aaac5425e901ceb727dbd030e: ending tablet copy session 4d2cdce5ab014334affbbb67c35c9ab7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4d2cdce5ab014334affbbb67c35c9ab7
I20260806 20:32:03.683212 24484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 20:32:03.685158 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:35643
--local_ip_for_outbound_sockets=127.13.149.65
--tserver_master_addrs=127.13.149.126:43615
--webserver_port=39169
--webserver_interface=127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab
--principal=oryx/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:03.693076 24844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:03.695021 24845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:03.696759 24848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:03.697052 24484 server_base.cc:1034] running on GCE node
I20260806 20:32:03.697388 24484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:03.698040 24484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:03.699333 24484 hybrid_clock.cc:648] HybridClock initialized: now 1786048323699289 us; error 39 us; skew 500 ppm
I20260806 20:32:03.699591 24484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:03 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048323, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:03.701607 24484 init.cc:377] Logged in from keytab as oryx/127.13.149.124@KRBTEST.COM (short username oryx)
I20260806 20:32:03.708942 24484 webserver.cc:460] Webserver started at http://127.13.149.124:36719/ using document root <none> and password file <none>
I20260806 20:32:03.709297 24484 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:03.709435 24484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:03.712154 24484 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 20:32:03.714053 24863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:03.714516 24484 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 20:32:03.714653 24484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
uuid: "4d2cdce5ab014334affbbb67c35c9ab7"
format_stamp: "Formatted at 2026-08-06 20:32:03 on dist-test-slave-2kcd"
server_key: "49589219f345682a6fcfc25aa49c7fcb"
server_key_iv: "06118c56fbe080cdfe413f0d12e21ea5"
server_key_version: "encryptionkey@0"
I20260806 20:32:03.714838 24484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:03.724723 24484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:03.728519 24484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:03.757771 24484 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.124:43345
I20260806 20:32:03.757800 24947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.124:43345 every 8 connection(s)
I20260806 20:32:03.758703 24484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
I20260806 20:32:03.766361 24950 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:32:03.770354 24950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Bootstrap starting.
I20260806 20:32:03.783977 24950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:32:03.784474 24950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Bootstrap complete.
I20260806 20:32:03.785521 24950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
I20260806 20:32:03.785778 24950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4d2cdce5ab014334affbbb67c35c9ab7, State: Initialized, Role: LEARNER
I20260806 20:32:03.786036 24950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } }
I20260806 20:32:03.789304 24961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:03.789621 24950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:03.789757 24961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: LEARNER
I20260806 20:32:03.815462 24977 catalog_manager.cc:1259] Loaded cluster ID: e9157dd5c9d64ab789e1ac4678fb5c91
I20260806 20:32:03.815584 24977 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: loading cluster ID for follower catalog manager: success
I20260806 20:32:03.818316 24977 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: acquiring CA information for follower catalog manager: success
I20260806 20:32:03.820214 24977 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 20:32:04.102052 24851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:04.102386 24851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:04.102562 24851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:04.110924 24851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:04.111079 24851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:04.111264 24851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:04.121922 24851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab
--principal=oryx/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:35643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=39169
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:04.123342 24851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:04.124717 24851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:04.138909 24984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:04.139081 24985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:04.139039 24992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:04.140265 24851 server_base.cc:1034] running on GCE node
I20260806 20:32:04.140980 24851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:04.141937 24851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:04.143206 24851 hybrid_clock.cc:648] HybridClock initialized: now 1786048324143131 us; error 56 us; skew 500 ppm
I20260806 20:32:04.143608 24851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:04.146986 24851 init.cc:377] Logged in from keytab as oryx/127.13.149.65@KRBTEST.COM (short username oryx)
I20260806 20:32:04.148536 24851 webserver.cc:460] Webserver started at http://127.13.149.65:39169/ using document root <none> and password file <none>
I20260806 20:32:04.149331 24851 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:04.149509 24851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:04.154954 24851 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260806 20:32:04.157727 25004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:04.159128 24851 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:04.159266 24851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "be8383825f834388951a5ece3f8d1da3"
format_stamp: "Formatted at 2026-08-06 20:32:00 on dist-test-slave-2kcd"
server_key: "79e2832acd3af1d62e493b6215962ec0"
server_key_iv: "4b8d1b9b1d3eab9bf5fb666800c8cd3a"
server_key_version: "encryptionkey@0"
I20260806 20:32:04.160238 24851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:04.182806 24814 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:04.183207 24814 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:04.194650 24851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:04.199059 25018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.182893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.0.0.1:57196)
0806 20:32:04.192009 (+ 9116us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:04.192035 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:04.192204 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:04.193393 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:04.193398 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:04.193426 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:04.193640 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.193650 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.195169 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.195175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.196690 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.196705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.198496 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.198501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.198645 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.198672 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 20:32:04.198738 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 20:32:04.198831 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8983,"thread_start_us":8868,"threads_started":1}
I20260806 20:32:04.199383 25019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.183036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57196 (local address 127.13.149.124:43345)
0806 20:32:04.192987 (+ 9951us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.193031 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.193053 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:32:04.193142 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.193146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.193226 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.193370 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:04.193811 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.194989 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.196896 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.198296 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.198527 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.198739 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.198800 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.198938 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9832,"thread_start_us":9687,"threads_started":1}
I20260806 20:32:04.200148 24851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:04.200301 24912 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 20:32:04.200518 24851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:04.200752 24961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b949e33aaac5425e901ceb727dbd030e. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: NON_VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: true } } }
I20260806 20:32:04.201078 24961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: LEARNER
I20260806 20:32:04.201676 24814 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: attempting to promote NON_VOTER 4d2cdce5ab014334affbbb67c35c9ab7 to VOTER
I20260806 20:32:04.201853 24851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:04.202384 24814 consensus_queue.cc:237] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } }
I20260806 20:32:04.203653 24851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:04.203768 24851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:04.203902 24851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:04.203998 24851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:04.204285 24574 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Refusing update from remote peer b949e33aaac5425e901ceb727dbd030e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 20:32:04.204432 24912 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 LEARNER]: Refusing update from remote peer b949e33aaac5425e901ceb727dbd030e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 20:32:04.204907 24814 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 20:32:04.205427 24814 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 20:32:04.207571 25014 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.210166 24912 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.213447 24961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.213788 24961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:32:04.214892 25015 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.215384 25015 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:04.215934 25015 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.216245 25015 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:04.216666 25015 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.216988 25015 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:04.221807 24574 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.227246 25053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b949e33aaac5425e901ceb727dbd030e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:04.227705 25053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:32:04.258785 24851 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:35643
I20260806 20:32:04.258872 25196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:35643 every 8 connection(s)
I20260806 20:32:04.260591 24851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:04.269497 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 24851
I20260806 20:32:04.269898 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 23923
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.125@KRBTEST.COM
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.124@KRBTEST.COM
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.66@KRBTEST.COM
I20260806 20:32:04.289551 25212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.265784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:34059 (local address 127.13.149.125:39387)
0806 20:32:04.266409 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.266415 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.266436 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:32:04.268415 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.268423 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.268540 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.268649 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.271392 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.272385 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.274612 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.275297 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.275423 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.281368 (+ 5945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.281378 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.281386 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.281432 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.285477 (+ 4045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.286471 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.286478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.286482 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.286668 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.287242 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.287247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.287250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.287636 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.287781 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.288849 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.289068 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":327,"threads_started":1}
I20260806 20:32:04.289872 25019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.266749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:55491 (local address 127.13.149.124:43345)
0806 20:32:04.266946 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.266953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.266974 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:32:04.268389 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.268396 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.268482 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.268623 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.274925 (+ 6302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.275993 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.278034 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.278737 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.278832 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.282948 (+ 4116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.282954 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.282960 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.283035 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.286791 (+ 3756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.287559 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.287563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.287567 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.287713 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.288175 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.288180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.288183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.288552 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.288707 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.289247 (+ 540us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.289507 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:32:04.291296 25213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.266402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.13.149.65:55491)
0806 20:32:04.266879 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:04.266893 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:04.268119 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:04.268890 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:04.268902 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:04.270084 (+ 1182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:04.274761 (+ 4677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.274771 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.276197 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.276202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.277842 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.277856 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.279136 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.279142 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.279339 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.279835 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:04.279862 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:04.282710 (+ 2848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:04.286935 (+ 4225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.286941 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.286944 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.287430 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.287858 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.287864 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.287867 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.288050 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.288806 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:04.288810 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:04.288943 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 20:32:04.290132 (+ 1189us) client_negotiation.cc:240] Negotiation successful
0806 20:32:04.290477 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":85,"thread_start_us":260,"threads_started":1}
I20260806 20:32:04.291319 25210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.265635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.13.149.65:34059)
0806 20:32:04.266260 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:04.266279 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:04.268113 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:04.268971 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:04.268977 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:04.270045 (+ 1068us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:04.271143 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.271171 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.272631 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.272637 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.274482 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.274499 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.275707 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.275713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.275877 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.276877 (+ 1000us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:04.276913 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:04.281050 (+ 4137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:04.285650 (+ 4600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.285659 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.285672 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.286314 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.286826 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.286833 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.286839 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.287102 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.287892 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:04.287899 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:04.288343 (+ 444us) client_negotiation.cc:769] Sending connection context
0806 20:32:04.289819 (+ 1476us) client_negotiation.cc:240] Negotiation successful
0806 20:32:04.290094 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":201,"spinlock_wait_cycles":49024,"thread_start_us":334,"threads_started":1}
I20260806 20:32:04.292507 25204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.263635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:47403 (local address 127.13.149.126:43615)
0806 20:32:04.264325 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.264332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.265332 (+ 1000us) server_negotiation.cc:407] Connection header received
0806 20:32:04.268484 (+ 3152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.268489 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.268579 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.268681 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.271392 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.272678 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.274272 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.274904 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.275042 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.281364 (+ 6322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.281371 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.281376 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.281422 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.286057 (+ 4635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.286879 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.286884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.286888 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.287050 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.287548 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.287553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.287556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.287910 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.288062 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.291266 (+ 3204us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.292108 (+ 842us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":347,"threads_started":1}
I20260806 20:32:04.293141 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.264276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.65:47403)
0806 20:32:04.265178 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:04.265220 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:04.268113 (+ 2893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:04.268985 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:04.268988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:04.270081 (+ 1093us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:04.271139 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.271165 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.272834 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.272839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.274119 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.274131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.275336 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.275343 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.275622 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.276983 (+ 1361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:04.277006 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:04.281098 (+ 4092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:04.286221 (+ 5123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.286232 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.286236 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.286734 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.287187 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.287192 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.287195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.287392 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.288123 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:04.288129 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:04.288355 (+ 226us) client_negotiation.cc:769] Sending connection context
0806 20:32:04.288677 (+ 322us) client_negotiation.cc:240] Negotiation successful
0806 20:32:04.289237 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":112,"spinlock_wait_cycles":35968,"thread_start_us":328,"threads_started":1}
I20260806 20:32:04.293269 25200 heartbeater.cc:347] Connected to a master server at 127.13.149.125:39387
I20260806 20:32:04.293480 25197 heartbeater.cc:347] Connected to a master server at 127.13.149.124:43345
I20260806 20:32:04.293656 25200 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:04.293654 25197 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:04.294059 25199 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43615
I20260806 20:32:04.294216 25199 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:04.294857 25199 heartbeater.cc:511] Master 127.13.149.126:43615 requested a full tablet report, sending...
I20260806 20:32:04.294919 25197 heartbeater.cc:511] Master 127.13.149.124:43345 requested a full tablet report, sending...
I20260806 20:32:04.294924 25200 heartbeater.cc:511] Master 127.13.149.125:39387 requested a full tablet report, sending...
I20260806 20:32:04.295259 25216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.271326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41308 (local address 127.13.149.66:46303)
0806 20:32:04.272017 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.272025 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.272052 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:32:04.272117 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.272124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.272336 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.272495 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.274549 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.276058 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.277996 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.278833 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.278986 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.285631 (+ 6645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.285645 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.285661 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.285701 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.289711 (+ 4010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.290714 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.290722 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.290725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.290888 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.291369 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.291374 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.291378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.291789 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.292132 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.294513 (+ 2381us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.294800 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":413,"threads_started":1}
I20260806 20:32:04.296578 24115 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:04.297430 23592 ts_manager.cc:194] Re-registered known tserver with Master: be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643)
I20260806 20:32:04.297844 24894 ts_manager.cc:194] Registered new tserver with Master: be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643)
I20260806 20:32:04.297873 24555 ts_manager.cc:194] Registered new tserver with Master: be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643)
I20260806 20:32:04.300192 23592 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:47403
I20260806 20:32:04.385677 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 23923
I20260806 20:32:04.407588 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:46303
--local_ip_for_outbound_sockets=127.13.149.66
--tserver_master_addrs=127.13.149.126:43615
--webserver_port=33559
--webserver_interface=127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab
--principal=oryx/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:04.748019 25218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:04.748293 25218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:04.748389 25218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:04.755656 25218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:04.755756 25218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:04.755868 25218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:04.765614 25218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab
--principal=oryx/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:46303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=33559
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:04.766902 25218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:04.768210 25218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:04.781692 25230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:04.781850 25226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:04.781826 25227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:04.783048 25218 server_base.cc:1034] running on GCE node
I20260806 20:32:04.783767 25218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:04.784667 25218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:04.785871 25218 hybrid_clock.cc:648] HybridClock initialized: now 1786048324785824 us; error 40 us; skew 500 ppm
I20260806 20:32:04.786202 25218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:04.789376 25218 init.cc:377] Logged in from keytab as oryx/127.13.149.66@KRBTEST.COM (short username oryx)
I20260806 20:32:04.790973 25218 webserver.cc:460] Webserver started at http://127.13.149.66:33559/ using document root <none> and password file <none>
I20260806 20:32:04.791738 25218 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:04.791911 25218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:04.797583 25218 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:32:04.800109 25241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:04.801520 25218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:04.801697 25218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "b4ff4778fd75408fbabfd75f01bfa30d"
format_stamp: "Formatted at 2026-08-06 20:32:01 on dist-test-slave-2kcd"
server_key: "7a9571f486b2708acbef35ef5e390e7b"
server_key_iv: "f69d4068aaf59259e150d553137e586b"
server_key_version: "encryptionkey@0"
I20260806 20:32:04.802652 25218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:04.815739 25218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:04.819528 25218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:04.819823 25218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:04.820886 25218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:04.822307 25218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:04.822394 25218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:04.822556 25218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:04.822660 25218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:04.856633 25218 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:46303
I20260806 20:32:04.856722 25413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:46303 every 8 connection(s)
I20260806 20:32:04.858111 25218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:04.862756 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 25218
I20260806 20:32:04.863101 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 24131
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.125@KRBTEST.COM
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.67@KRBTEST.COM
I20260806 20:32:04.889706 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.861228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:33489 (local address 127.13.149.125:39387)
0806 20:32:04.861704 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.861709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.862921 (+ 1212us) server_negotiation.cc:407] Connection header received
0806 20:32:04.866177 (+ 3256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.866187 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.866304 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.866417 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.869354 (+ 2937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.870926 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.874157 (+ 3231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.875065 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.875185 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.880886 (+ 5701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.880893 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.880897 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.880939 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.885393 (+ 4454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.886425 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.886434 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.886441 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.886598 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.887212 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.887219 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.887225 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.887635 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.887783 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.889000 (+ 1217us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.889285 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":233,"threads_started":1}
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:04.892601 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.861782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.13.149.66:33489)
0806 20:32:04.862700 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:04.862756 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:04.865755 (+ 2999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:04.867096 (+ 1341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:04.867111 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:04.868050 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:04.869102 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.869133 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.871206 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.871215 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.873935 (+ 2720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.873956 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.875522 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.875527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.875739 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.876450 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:04.876485 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:04.880602 (+ 4117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:04.885570 (+ 4968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.885581 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.885599 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.886267 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.886770 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.886776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.886781 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.887071 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.887900 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:04.887909 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:04.888426 (+ 517us) client_negotiation.cc:769] Sending connection context
0806 20:32:04.890026 (+ 1600us) client_negotiation.cc:240] Negotiation successful
0806 20:32:04.890737 (+ 711us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":348,"threads_started":1}
I20260806 20:32:04.894763 25421 heartbeater.cc:347] Connected to a master server at 127.13.149.125:39387
I20260806 20:32:04.895205 25421 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:04.896906 25421 heartbeater.cc:511] Master 127.13.149.125:39387 requested a full tablet report, sending...
I20260806 20:32:04.901046 24555 ts_manager.cc:194] Registered new tserver with Master: b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:04.902287 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.864142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49402 (local address 127.13.149.67:44933)
0806 20:32:04.875601 (+ 11459us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.875614 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.875648 (+ 34us) server_negotiation.cc:407] Connection header received
0806 20:32:04.875733 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.875744 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.876072 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.876248 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.878445 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.879514 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.881422 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.882517 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.882712 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.889966 (+ 7254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.889985 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.890002 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.890044 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.896505 (+ 6461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.897898 (+ 1393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.897919 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.897922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.898268 (+ 346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.898967 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.898973 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.898979 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.899608 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.900126 (+ 518us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.901543 (+ 1417us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.901761 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11223,"thread_start_us":11006,"threads_started":1}
I20260806 20:32:04.903748 24315 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:04.904551 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.863037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.66:56389)
0806 20:32:04.877062 (+ 14025us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:04.877082 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:04.877264 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:04.877944 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:04.877952 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:04.879716 (+ 1764us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:04.880160 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.880176 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.882549 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.882557 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.884929 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.884948 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.886412 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.886420 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.886660 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.887637 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:04.887667 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:04.892756 (+ 5089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:04.900680 (+ 7924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.900684 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.900688 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.901295 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.902003 (+ 708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.902008 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.902012 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.902193 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.903209 (+ 1016us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:04.903214 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:04.903425 (+ 211us) client_negotiation.cc:769] Sending connection context
0806 20:32:04.903572 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 20:32:04.903982 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13870,"mutex_wait_us":78,"thread_start_us":13649,"threads_started":1}
I20260806 20:32:04.904568 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.863303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:56389 (local address 127.13.149.126:43615)
0806 20:32:04.874156 (+ 10853us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.874165 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.877162 (+ 2997us) server_negotiation.cc:407] Connection header received
0806 20:32:04.877432 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.877440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.877563 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.877665 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.880398 (+ 2733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.882296 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.885118 (+ 2822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.885964 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.886085 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.893064 (+ 6979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.893073 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.893081 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.893160 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.900537 (+ 7377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.901600 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.901607 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.901612 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.901858 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.902608 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.902613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.902617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.903083 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.903244 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.903684 (+ 440us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.903924 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10663,"thread_start_us":10860,"threads_started":1}
I20260806 20:32:04.905418 25420 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43615
I20260806 20:32:04.905566 25420 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:04.906085 25420 heartbeater.cc:511] Master 127.13.149.126:43615 requested a full tablet report, sending...
I20260806 20:32:04.907238 23592 ts_manager.cc:194] Re-registered known tserver with Master: b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:04.908417 23592 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:56389
Aug 06 20:32:04 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048324, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.124@KRBTEST.COM
I20260806 20:32:04.917963 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.877277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:53851 (local address 127.13.149.124:43345)
0806 20:32:04.898407 (+ 21130us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:04.898416 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:04.898438 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:32:04.898497 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:04.898504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:04.898620 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:04.898768 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:04.901541 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.902772 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.905481 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.906142 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.906273 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.912375 (+ 6102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:04.912382 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:04.912387 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:04.912425 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:04.915269 (+ 2844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.916016 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.916020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.916022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.916174 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:04.916614 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:04.916617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:04.916619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:04.916964 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:04.917077 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:04.917557 (+ 480us) server_negotiation.cc:299] Negotiation successful
0806 20:32:04.917710 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20964,"thread_start_us":20852,"threads_started":1}
I20260806 20:32:04.918196 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:04.884025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.13.149.66:53851)
0806 20:32:04.897364 (+ 13339us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:04.897385 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:04.897537 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:04.899074 (+ 1537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:04.899079 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:04.900231 (+ 1152us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:04.900558 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.900572 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.902971 (+ 2399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.902976 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.905272 (+ 2296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:04.905293 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:04.906565 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:04.906574 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:04.906801 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:04.907476 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:04.907501 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:04.912156 (+ 4655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:04.915422 (+ 3266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.915428 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.915433 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.915898 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.916294 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:04.916300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:04.916304 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:04.916497 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:04.917076 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:04.917083 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:04.917274 (+ 191us) client_negotiation.cc:769] Sending connection context
0806 20:32:04.917421 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 20:32:04.917766 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13088,"mutex_wait_us":70,"thread_start_us":6944,"threads_started":1}
I20260806 20:32:04.919139 25415 heartbeater.cc:347] Connected to a master server at 127.13.149.124:43345
I20260806 20:32:04.919288 25415 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:04.919651 25415 heartbeater.cc:511] Master 127.13.149.124:43345 requested a full tablet report, sending...
I20260806 20:32:04.920747 24894 ts_manager.cc:194] Registered new tserver with Master: b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:04.994357 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 24131
I20260806 20:32:05.019722 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:44933
--local_ip_for_outbound_sockets=127.13.149.67
--tserver_master_addrs=127.13.149.126:43615
--webserver_port=36429
--webserver_interface=127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab
--principal=oryx/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:32:05.302461 25199 heartbeater.cc:503] Master 127.13.149.126:43615 was elected leader, sending a full tablet report...
W20260806 20:32:05.372335 25440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:05.372650 25440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:05.372877 25440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:05.380592 25440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:05.380757 25440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:05.380993 25440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:05.392432 25440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab
--principal=oryx/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:44933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=36429
--tserver_master_addrs=127.13.149.126:43615,127.13.149.125:39387,127.13.149.124:43345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:05.393949 25440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:05.395390 25440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:05.409130 25448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:05.409272 25447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:05.409268 25452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:05.410141 25440 server_base.cc:1034] running on GCE node
I20260806 20:32:05.410820 25440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:05.411721 25440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:05.412943 25440 hybrid_clock.cc:648] HybridClock initialized: now 1786048325412895 us; error 59 us; skew 500 ppm
I20260806 20:32:05.413297 25440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:05 dist-test-slave-2kcd krb5kdc[23520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048325, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:05.416512 25440 init.cc:377] Logged in from keytab as oryx/127.13.149.67@KRBTEST.COM (short username oryx)
I20260806 20:32:05.418174 25440 webserver.cc:460] Webserver started at http://127.13.149.67:36429/ using document root <none> and password file <none>
I20260806 20:32:05.418891 25440 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:05.419073 25440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:05.424501 25440 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:05.427304 25460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:05.428632 25440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:32:05.428860 25440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "78a790cb6a2c4acf8a7e0873a226d545"
format_stamp: "Formatted at 2026-08-06 20:32:02 on dist-test-slave-2kcd"
server_key: "ada5e74152e95d9c7c9f12dee23bb4b6"
server_key_iv: "a0e74c69c1d0d62c7f1d26eb9fd78544"
server_key_version: "encryptionkey@0"
I20260806 20:32:05.429855 25440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:05.451399 25440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:05.455319 25440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:05.455619 25440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:05.456583 25440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:05.457991 25440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:05.458118 25440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:05.458261 25440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:05.458374 25440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:05.494911 25440 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:44933
I20260806 20:32:05.494971 25653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:44933 every 8 connection(s)
I20260806 20:32:05.496480 25440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:05.506245 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 25440
Aug 06 20:32:05 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048325, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.125@KRBTEST.COM
Aug 06 20:32:05 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048325, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.124@KRBTEST.COM
Aug 06 20:32:05 dist-test-slave-2kcd krb5kdc[23520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048325, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:05.525226 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.502770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.13.149.67:36593)
0806 20:32:05.506073 (+ 3303us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.506092 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.506204 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.506767 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.506772 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.507627 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:05.508023 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.508036 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.509477 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.509482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.510973 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.510986 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.512243 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.512251 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.512490 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.513164 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:05.513186 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:05.515676 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:05.519944 (+ 4268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:05.519952 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:05.519970 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:05.520703 (+ 733us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:05.521204 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:05.521211 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:05.521215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:05.521445 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:05.522233 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:05.522241 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:05.522691 (+ 450us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.523042 (+ 351us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.523607 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3182,"mutex_wait_us":2,"thread_start_us":2965,"threads_started":1}
I20260806 20:32:05.525269 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.500258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.13.149.67:46787)
0806 20:32:05.501026 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.501065 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.503428 (+ 2363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.504262 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.504270 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.504878 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:05.505440 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.505466 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.506992 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.506997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.509286 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.509298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.510597 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.510605 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.510986 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.511874 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:05.511910 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:05.515550 (+ 3640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:05.520343 (+ 4793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:05.520356 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:05.520363 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:05.521103 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:05.521816 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:05.521824 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:05.521830 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:05.522053 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:05.522868 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:05.522875 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:05.523108 (+ 233us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.523263 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.523815 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":131,"thread_start_us":280,"threads_started":1}
I20260806 20:32:05.525961 25664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.501434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.67:44361)
0806 20:32:05.502084 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.502103 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.503428 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.507220 (+ 3792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.507225 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.508035 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:05.508476 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.508496 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.510587 (+ 2091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.510595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.513639 (+ 3044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.513655 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.514838 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.514848 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.515104 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.515714 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:05.515741 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:05.518526 (+ 2785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:05.522587 (+ 4061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:05.522591 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:05.522595 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:05.523127 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:05.523563 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:05.523570 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:05.523576 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:05.523744 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:05.524396 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:05.524400 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:05.524568 (+ 168us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.524693 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.524994 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":281,"threads_started":1}
I20260806 20:32:05.526647 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.502405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:36593 (local address 127.13.149.124:43345)
0806 20:32:05.502937 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.502945 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.506302 (+ 3357us) server_negotiation.cc:407] Connection header received
0806 20:32:05.506371 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.506376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.506461 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.506591 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.508216 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.509303 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.511217 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.511822 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.511950 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.515938 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.515943 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.515946 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.515980 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.519779 (+ 3799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.520855 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.520864 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.520873 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.521034 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.521601 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.521606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.521609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.521996 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.522135 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.526018 (+ 3883us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.526267 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":482,"threads_started":1}
I20260806 20:32:05.526755 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.499618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:46787 (local address 127.13.149.125:39387)
0806 20:32:05.500203 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.500208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.501184 (+ 976us) server_negotiation.cc:407] Connection header received
0806 20:32:05.503767 (+ 2583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.503773 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.503854 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.503922 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.505621 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.506782 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.509476 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.510141 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.510248 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.515841 (+ 5593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.515848 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.515853 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.515910 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.520153 (+ 4243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.521423 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.521432 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.521438 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.521653 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.522227 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.522235 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.522240 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.522689 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.525104 (+ 2415us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.525867 (+ 763us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.526173 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":356,"threads_started":1}
I20260806 20:32:05.527772 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.501644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44361 (local address 127.13.149.126:43615)
0806 20:32:05.506303 (+ 4659us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.506310 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.506332 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:32:05.506404 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.506409 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.506489 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.506610 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.508736 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.510318 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.513853 (+ 3535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.514542 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.515436 (+ 894us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.518734 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.518741 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.518745 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.518787 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.522443 (+ 3656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.523278 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.523283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.523286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.523430 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.523888 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.523892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.523895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.524246 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.526595 (+ 2349us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.527146 (+ 551us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.527395 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4531,"thread_start_us":5380,"threads_started":1}
I20260806 20:32:05.528086 25654 heartbeater.cc:347] Connected to a master server at 127.13.149.124:43345
I20260806 20:32:05.528117 25658 heartbeater.cc:347] Connected to a master server at 127.13.149.125:39387
I20260806 20:32:05.528445 25658 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:05.528838 25655 heartbeater.cc:347] Connected to a master server at 127.13.149.126:43615
I20260806 20:32:05.529000 25655 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:05.528460 25654 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:05.529613 25658 heartbeater.cc:511] Master 127.13.149.125:39387 requested a full tablet report, sending...
I20260806 20:32:05.529899 25655 heartbeater.cc:511] Master 127.13.149.126:43615 requested a full tablet report, sending...
I20260806 20:32:05.529929 25654 heartbeater.cc:511] Master 127.13.149.124:43345 requested a full tablet report, sending...
I20260806 20:32:05.531500 23592 ts_manager.cc:194] Re-registered known tserver with Master: 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67:44933)
I20260806 20:32:05.531723 24555 ts_manager.cc:194] Registered new tserver with Master: 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67:44933)
I20260806 20:32:05.531775 24894 ts_manager.cc:194] Registered new tserver with Master: 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67:44933)
I20260806 20:32:05.532747 23592 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:44361
I20260806 20:32:05.550855 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.529657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44060 (local address 127.13.149.126:43615)
0806 20:32:05.529850 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.529859 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.531025 (+ 1166us) server_negotiation.cc:407] Connection header received
0806 20:32:05.531074 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.531079 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.531155 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.531242 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.533832 (+ 2590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.535134 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.537755 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.538210 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.538349 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.542368 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.542376 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.542380 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.542417 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.546572 (+ 4155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.547570 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.547578 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.547582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.547742 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.548305 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.548312 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.548317 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.548770 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.549088 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.550237 (+ 1149us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.550485 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 20:32:05.551127 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.531160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35660 (local address 127.13.149.125:39387)
0806 20:32:05.532094 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.532100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.533753 (+ 1653us) server_negotiation.cc:407] Connection header received
0806 20:32:05.534013 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.534018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.534092 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.534166 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.536715 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.537648 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.539547 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.540167 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.540276 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.543765 (+ 3489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.543772 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.543777 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.543814 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.547524 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.548434 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.548439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.548443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.548617 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.549096 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.549101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.549106 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.549436 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.549703 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.550564 (+ 861us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.550794 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803}
I20260806 20:32:05.555652 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.533927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57198 (local address 127.13.149.124:43345)
0806 20:32:05.534083 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.534089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.537380 (+ 3291us) server_negotiation.cc:407] Connection header received
0806 20:32:05.538651 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.538656 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.538750 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.538829 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.541524 (+ 2695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.542594 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.544820 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.545584 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.545694 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.549408 (+ 3714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.549415 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.549419 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.549472 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.552851 (+ 3379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.553653 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.553657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.553659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.553844 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.554230 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.554234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.554237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.554633 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.554879 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.555207 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.555371 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 20:32:05.555583 23592 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:32:05.562937 23592 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:05.596853 25696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.585298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:44933 (local address 127.0.0.1:49404)
0806 20:32:05.586116 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.586149 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.586314 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.588740 (+ 2426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.588749 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.588802 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:05.589127 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.589140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.591726 (+ 2586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.591732 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.594279 (+ 2547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.594295 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.595889 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.595895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.596199 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.596225 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.596323 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.596457 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":275,"threads_started":1}
I20260806 20:32:05.596884 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.587200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49404 (local address 127.13.149.67:44933)
0806 20:32:05.588014 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.588022 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.588050 (+ 28us) server_negotiation.cc:407] Connection header received
0806 20:32:05.588188 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.588198 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.588493 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.589553 (+ 1060us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:05.589885 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.591592 (+ 1707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.594467 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.595721 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.595878 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.596115 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.596390 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.596537 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":1081,"threads_started":1}
I20260806 20:32:05.598110 25700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.587005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41314 (local address 127.13.149.66:46303)
0806 20:32:05.589126 (+ 2121us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.589132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.589153 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:32:05.589233 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.589238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.589504 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.590629 (+ 1125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:05.590801 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.591985 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.594686 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.596175 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.596301 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.596506 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.597650 (+ 1144us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.597767 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1983,"thread_start_us":1856,"threads_started":1}
I20260806 20:32:05.598114 25699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.586682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46303 (local address 127.0.0.1:41314)
0806 20:32:05.587173 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.587186 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.587271 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.589725 (+ 2454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.589729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.589752 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:05.590254 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.590265 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.592129 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.592138 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.594509 (+ 2371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.594525 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.596663 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.596670 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.596916 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.597495 (+ 579us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.597596 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.597719 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":26,"thread_start_us":1474,"threads_started":1}
I20260806 20:32:05.598577 25697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.585928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35643 (local address 127.0.0.1:39472)
0806 20:32:05.586530 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.586543 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.586680 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.589522 (+ 2842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.589526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.589550 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:05.590054 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.590072 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.592266 (+ 2194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.592273 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.594813 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.594839 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.596717 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.596724 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.597943 (+ 1219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.597981 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.598075 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.598212 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":94,"thread_start_us":318,"threads_started":1}
I20260806 20:32:05.599622 25703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.587910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39472 (local address 127.13.149.65:35643)
0806 20:32:05.588929 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.588937 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.588962 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:32:05.589058 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.589066 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.589286 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.590280 (+ 994us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:05.590523 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.592065 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.595050 (+ 2985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.596473 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.598856 (+ 2383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.599077 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.599143 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.599314 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":605,"threads_started":1}
I20260806 20:32:05.600760 25541 tablet_service.cc:1467] Processing CreateTablet for tablet 03dc011101a74dc6a3a47463aad903c7 (DEFAULT_TABLE table=test-table [id=bd100ee36ed243d6bbf9fe8aed78b447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:05.602378 25541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03dc011101a74dc6a3a47463aad903c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:05.602218 25319 tablet_service.cc:1467] Processing CreateTablet for tablet 03dc011101a74dc6a3a47463aad903c7 (DEFAULT_TABLE table=test-table [id=bd100ee36ed243d6bbf9fe8aed78b447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:05.602728 25097 tablet_service.cc:1467] Processing CreateTablet for tablet 03dc011101a74dc6a3a47463aad903c7 (DEFAULT_TABLE table=test-table [id=bd100ee36ed243d6bbf9fe8aed78b447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:05.603510 25319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03dc011101a74dc6a3a47463aad903c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:05.603991 25097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03dc011101a74dc6a3a47463aad903c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:05.618605 25704 tablet_bootstrap.cc:492] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Bootstrap starting.
I20260806 20:32:05.619861 25706 tablet_bootstrap.cc:492] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Bootstrap starting.
I20260806 20:32:05.620703 25708 tablet_bootstrap.cc:492] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Bootstrap starting.
I20260806 20:32:05.623268 25704 tablet_bootstrap.cc:654] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:05.624212 25706 tablet_bootstrap.cc:654] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:05.624625 25704 log.cc:824] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:05.625527 25706 log.cc:824] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:05.627656 25708 tablet_bootstrap.cc:654] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:05.628197 25704 tablet_bootstrap.cc:492] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: No bootstrap required, opened a new log
I20260806 20:32:05.628468 25704 ts_tablet_manager.cc:1397] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 20:32:05.628960 25708 log.cc:824] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:05.630247 25706 tablet_bootstrap.cc:492] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: No bootstrap required, opened a new log
I20260806 20:32:05.630605 25706 ts_tablet_manager.cc:1397] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260806 20:32:05.631914 25708 tablet_bootstrap.cc:492] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: No bootstrap required, opened a new log
I20260806 20:32:05.632164 25708 ts_tablet_manager.cc:1397] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.003s
I20260806 20:32:05.636549 25704 raft_consensus.cc:348] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.636983 25704 raft_consensus.cc:374] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:05.637105 25704 raft_consensus.cc:729] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8383825f834388951a5ece3f8d1da3, State: Initialized, Role: FOLLOWER
I20260806 20:32:05.637694 25704 consensus_queue.cc:260] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.639371 25704 ts_tablet_manager.cc:1428] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260806 20:32:05.641126 25706 raft_consensus.cc:348] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.641536 25706 raft_consensus.cc:374] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:05.641628 25706 raft_consensus.cc:729] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ff4778fd75408fbabfd75f01bfa30d, State: Initialized, Role: FOLLOWER
I20260806 20:32:05.642185 25706 consensus_queue.cc:260] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.642970 25708 raft_consensus.cc:348] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.643353 25708 raft_consensus.cc:374] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:05.643450 25708 raft_consensus.cc:729] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a790cb6a2c4acf8a7e0873a226d545, State: Initialized, Role: FOLLOWER
I20260806 20:32:05.643882 25706 ts_tablet_manager.cc:1428] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Time spent starting tablet: real 0.013s user 0.005s sys 0.009s
I20260806 20:32:05.643999 25708 consensus_queue.cc:260] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.644428 25420 heartbeater.cc:503] Master 127.13.149.126:43615 was elected leader, sending a full tablet report...
I20260806 20:32:05.651378 25655 heartbeater.cc:503] Master 127.13.149.126:43615 was elected leader, sending a full tablet report...
I20260806 20:32:05.651559 25708 ts_tablet_manager.cc:1428] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Time spent starting tablet: real 0.019s user 0.012s sys 0.008s
I20260806 20:32:05.740957 25718 raft_consensus.cc:482] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:05.741271 25718 raft_consensus.cc:504] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.743011 25718 leader_election.cc:288] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643), b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:05.749163 25703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.743315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:34833 (local address 127.13.149.65:35643)
0806 20:32:05.743588 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.743594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.744141 (+ 547us) server_negotiation.cc:407] Connection header received
0806 20:32:05.744293 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.744299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.744373 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.744487 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:05.744940 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.745609 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.747304 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.748089 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.748280 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.748357 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.748749 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.748897 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 20:32:05.749166 25700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.743444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:53091 (local address 127.13.149.66:46303)
0806 20:32:05.743656 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.743664 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.743883 (+ 219us) server_negotiation.cc:407] Connection header received
0806 20:32:05.744064 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.744072 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.744155 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.744253 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:05.744688 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.745568 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.747316 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.748117 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.748281 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.748356 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.748748 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.748899 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 20:32:05.749183 25664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.743530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35643 (local address 127.13.149.67:34833)
0806 20:32:05.744037 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.744055 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.744169 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.744497 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.744500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.744526 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:05.744737 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.744750 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.745772 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.745793 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.747142 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.747154 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.748272 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.748279 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.748567 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.748611 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.748711 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.748862 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":181}
I20260806 20:32:05.749190 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.743533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46303 (local address 127.13.149.67:53091)
0806 20:32:05.743765 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:05.743789 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:05.743912 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:05.744284 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:05.744289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:05.744315 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:05.744525 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.744537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.745736 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.745742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.747160 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:05.747172 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.748283 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.748289 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:05.748567 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.748616 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 20:32:05.748717 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 20:32:05.748878 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":79}
W20260806 20:32:05.749898 25659 tablet.cc:2369] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:32:05.750279 25122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03dc011101a74dc6a3a47463aad903c7" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8383825f834388951a5ece3f8d1da3" is_pre_election: true
I20260806 20:32:05.750587 25347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03dc011101a74dc6a3a47463aad903c7" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" is_pre_election: true
I20260806 20:32:05.750785 25122 raft_consensus.cc:2454] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 0.
I20260806 20:32:05.751152 25347 raft_consensus.cc:2454] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 0.
I20260806 20:32:05.751520 25463 leader_election.cc:302] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78a790cb6a2c4acf8a7e0873a226d545, be8383825f834388951a5ece3f8d1da3; no voters:
I20260806 20:32:05.751946 25718 raft_consensus.cc:2781] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:05.752087 25718 raft_consensus.cc:482] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:05.752194 25718 raft_consensus.cc:3037] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:05.754488 25718 raft_consensus.cc:504] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
I20260806 20:32:05.755103 25718 leader_election.cc:288] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 election: Requested vote from peers be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643), b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:05.755501 25122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03dc011101a74dc6a3a47463aad903c7" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8383825f834388951a5ece3f8d1da3"
I20260806 20:32:05.755520 25347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03dc011101a74dc6a3a47463aad903c7" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ff4778fd75408fbabfd75f01bfa30d"
I20260806 20:32:05.755677 25122 raft_consensus.cc:3037] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:05.755709 25347 raft_consensus.cc:3037] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:05.758068 25347 raft_consensus.cc:2454] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 1.
I20260806 20:32:05.758489 25462 leader_election.cc:302] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78a790cb6a2c4acf8a7e0873a226d545, b4ff4778fd75408fbabfd75f01bfa30d; no voters:
I20260806 20:32:05.758540 25122 raft_consensus.cc:2454] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 1.
I20260806 20:32:05.758802 25718 raft_consensus.cc:2781] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:05.759289 25718 raft_consensus.cc:686] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 LEADER]: Becoming Leader. State: Replica: 78a790cb6a2c4acf8a7e0873a226d545, State: Running, Role: LEADER
I20260806 20:32:05.760054 25718 consensus_queue.cc:237] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } }
W20260806 20:32:05.764664 25201 tablet.cc:2369] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:32:05.766717 23592 catalog_manager.cc:5495] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "78a790cb6a2c4acf8a7e0873a226d545" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } health_report { overall_health: UNKNOWN } } }
I20260806 20:32:05.786643 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.780954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49410 (local address 127.13.149.67:44933)
0806 20:32:05.781210 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.781217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.781320 (+ 103us) server_negotiation.cc:407] Connection header received
0806 20:32:05.781576 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.781584 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.781699 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.781873 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:05.782270 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.783110 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.784564 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.785045 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.785144 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.785639 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:05.786158 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:05.786275 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.786369 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.786437 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 20:32:05.795341 25122 raft_consensus.cc:1261] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Refusing update from remote peer 78a790cb6a2c4acf8a7e0873a226d545: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:05.795338 25347 raft_consensus.cc:1261] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Refusing update from remote peer 78a790cb6a2c4acf8a7e0873a226d545: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:05.796506 25719 consensus_queue.cc:1035] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:05.796948 25718 consensus_queue.cc:1035] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:05.833035 23592 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:05.833360 23592 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:05.839828 23592 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b949e33aaac5425e901ceb727dbd030e: Sending DeleteTablet for 3 replicas of tablet 03dc011101a74dc6a3a47463aad903c7
I20260806 20:32:05.840991 25541 tablet_service.cc:1514] Processing DeleteTablet for tablet 03dc011101a74dc6a3a47463aad903c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:05 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:49404
I20260806 20:32:05.841952 25319 tablet_service.cc:1514] Processing DeleteTablet for tablet 03dc011101a74dc6a3a47463aad903c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:05 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41314
I20260806 20:32:05.841935 25097 tablet_service.cc:1514] Processing DeleteTablet for tablet 03dc011101a74dc6a3a47463aad903c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:05 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:39472
I20260806 20:32:05.851990 25745 tablet_replica.cc:330] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: stopping tablet replica
I20260806 20:32:05.852628 25746 tablet_replica.cc:330] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: stopping tablet replica
I20260806 20:32:05.853271 25746 raft_consensus.cc:2229] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:05.853817 25745 raft_consensus.cc:2229] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:05.854435 25746 raft_consensus.cc:2258] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:05.855020 25745 raft_consensus.cc:2258] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:05.855119 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 23539
I20260806 20:32:05.856215 23648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:05.857949 25745 ts_tablet_manager.cc:1905] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:05.859632 25746 ts_tablet_manager.cc:1905] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:05.865410 25744 tablet_replica.cc:330] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: stopping tablet replica
I20260806 20:32:05.865835 25744 raft_consensus.cc:2229] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:32:05.866444 25744 raft_consensus.cc:2258] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:05.868508 25744 ts_tablet_manager.cc:1905] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:05.872597 25745 ts_tablet_manager.cc:1918] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:05.872849 25745 log.cc:1196] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/03dc011101a74dc6a3a47463aad903c7
I20260806 20:32:05.873471 25745 ts_tablet_manager.cc:1939] T 03dc011101a74dc6a3a47463aad903c7 P b4ff4778fd75408fbabfd75f01bfa30d: Deleting consensus metadata
I20260806 20:32:05.878994 25744 ts_tablet_manager.cc:1918] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:05.879267 25744 log.cc:1196] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/03dc011101a74dc6a3a47463aad903c7
I20260806 20:32:05.879914 25744 ts_tablet_manager.cc:1939] T 03dc011101a74dc6a3a47463aad903c7 P 78a790cb6a2c4acf8a7e0873a226d545: Deleting consensus metadata
I20260806 20:32:05.880649 25746 ts_tablet_manager.cc:1918] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:05.880890 25746 log.cc:1196] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/03dc011101a74dc6a3a47463aad903c7
I20260806 20:32:05.881508 25746 ts_tablet_manager.cc:1939] T 03dc011101a74dc6a3a47463aad903c7 P be8383825f834388951a5ece3f8d1da3: Deleting consensus metadata
I20260806 20:32:05.891424 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.845296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.13.149.125:39387)
0806 20:32:05.845533 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.845542 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.853636 (+ 8094us) server_negotiation.cc:407] Connection header received
0806 20:32:05.853862 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.853867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.853959 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.854084 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.870730 (+ 16646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.871966 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.873866 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.874469 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.874606 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.881429 (+ 6823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.881436 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.881441 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.881491 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.885624 (+ 4133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.886496 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.886505 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.886510 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.886700 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.889277 (+ 2577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.889283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.889287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.889763 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.890025 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.890783 (+ 758us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.891038 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 20:32:05.913623 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:05.853541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57208 (local address 127.13.149.124:43345)
0806 20:32:05.853735 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:05.853742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:05.893639 (+ 39897us) server_negotiation.cc:407] Connection header received
0806 20:32:05.893730 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:05.893735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:05.893825 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:05.893936 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:05.895690 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.896942 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.902546 (+ 5604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:05.903237 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:05.903376 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:05.907014 (+ 3638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:05.907021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:05.907026 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:05.907076 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:05.910619 (+ 3543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.911367 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.911372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.911376 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.911550 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:05.911962 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:05.911976 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:05.911979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:05.912347 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:05.912612 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:05.913028 (+ 416us) server_negotiation.cc:299] Negotiation successful
0806 20:32:05.913248 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 20:32:06.012704 23558 catalog_manager.cc:4841] TS b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303): tablet 03dc011101a74dc6a3a47463aad903c7 (table test-table [id=bd100ee36ed243d6bbf9fe8aed78b447]) successfully deleted
W20260806 20:32:06.013078 23558 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.149.66:46303, user_credentials={real_user=slave}} blocked reactor thread for 137751us
I20260806 20:32:06.013402 23559 catalog_manager.cc:4841] TS be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643): tablet 03dc011101a74dc6a3a47463aad903c7 (table test-table [id=bd100ee36ed243d6bbf9fe8aed78b447]) successfully deleted
W20260806 20:32:06.013583 23559 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.149.65:35643, user_credentials={real_user=slave}} blocked reactor thread for 130128us
I20260806 20:32:06.013913 23559 catalog_manager.cc:4841] TS 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67:44933): tablet 03dc011101a74dc6a3a47463aad903c7 (table test-table [id=bd100ee36ed243d6bbf9fe8aed78b447]) successfully deleted
I20260806 20:32:06.017163 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 23539
I20260806 20:32:06.083033 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:06.067368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57224 (local address 127.13.149.124:43345)
0806 20:32:06.067615 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:06.067622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:06.067942 (+ 320us) server_negotiation.cc:407] Connection header received
0806 20:32:06.068114 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:06.068119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:06.068210 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:06.068324 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:06.070561 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:06.071659 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:06.073192 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:06.073874 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:06.074007 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:06.077041 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:06.077046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:06.077049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:06.077081 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:06.079899 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:06.080765 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:06.080771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:06.080775 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:06.080958 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:06.081344 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:06.081349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:06.081353 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:06.081726 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:06.081980 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:06.082430 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 20:32:06.082657 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 20:32:06.083272 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:06.066496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35664 (local address 127.13.149.125:39387)
0806 20:32:06.066745 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:06.066751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:06.066856 (+ 105us) server_negotiation.cc:407] Connection header received
0806 20:32:06.067186 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:06.067193 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:06.067284 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:06.067366 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:06.069394 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:06.070097 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:06.071820 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:06.072502 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:06.072635 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:06.076328 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:06.076335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:06.076339 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:06.076382 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:06.080151 (+ 3769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:06.080984 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:06.080990 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:06.080994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:06.081149 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:06.081587 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:06.081591 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:06.081595 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:06.081971 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:06.082210 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:06.082708 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 20:32:06.082930 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:32:06.823213 25761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:06.822192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.67:38383)
0806 20:32:06.822727 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:06.822905 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":276,"threads_started":1}
W20260806 20:32:06.823575 25655 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:43615 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:06.827637 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:06.826876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.66:59063)
0806 20:32:06.827277 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:06.827445 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":226,"threads_started":1}
W20260806 20:32:06.828053 25420 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:43615 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:06.831094 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:06.830266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.65:39963)
0806 20:32:06.830755 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:06.830896 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":281,"threads_started":1}
W20260806 20:32:06.831539 25199 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:43615 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:07.339845 25767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b949e33aaac5425e901ceb727dbd030e)
I20260806 20:32:07.340117 25767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } }
I20260806 20:32:07.340979 25767 leader_election.cc:288] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615), 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125:39387)
I20260806 20:32:07.341149 25769 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b949e33aaac5425e901ceb727dbd030e)
I20260806 20:32:07.341444 25769 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } }
I20260806 20:32:07.342347 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.341072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44470)
0806 20:32:07.341791 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.341984 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":338,"threads_started":1}
W20260806 20:32:07.343380 24870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:07.344606 25773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.343323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44480)
0806 20:32:07.343914 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.344180 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":262,"threads_started":1}
I20260806 20:32:07.345618 25769 leader_election.cc:288] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615), 4d2cdce5ab014334affbbb67c35c9ab7 (127.13.149.124:43345)
W20260806 20:32:07.346349 24526 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:07.346715 25771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.346116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44484)
0806 20:32:07.346325 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.346444 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260806 20:32:07.346961 24870 leader_election.cc:334] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615): Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:07.349185 25779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.348599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44492)
0806 20:32:07.348809 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.348973 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 20:32:07.349402 24526 leader_election.cc:334] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615): Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:07.351192 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.341784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:39387 (local address 127.0.0.1:35678)
0806 20:32:07.342639 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.342657 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:07.342790 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:07.344114 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:07.344118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:07.344180 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:07.344466 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.344479 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.346757 (+ 2278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.346764 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.348938 (+ 2174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.348950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.350433 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.350439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.350626 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.350650 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 20:32:07.350756 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 20:32:07.350892 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":1241,"threads_started":1}
I20260806 20:32:07.351295 25772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.341868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35678 (local address 127.13.149.125:39387)
0806 20:32:07.343758 (+ 1890us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.343764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.343783 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:32:07.343856 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.343860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.343947 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.344626 (+ 679us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:07.345028 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.346538 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.349092 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.350264 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.350446 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.350522 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.350780 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.350910 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":1677,"thread_start_us":1447,"threads_started":1}
I20260806 20:32:07.351785 24574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5b89d1565a304103ac5c6df9a68d8963" is_pre_election: true
I20260806 20:32:07.352032 24574 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d2cdce5ab014334affbbb67c35c9ab7 in term 1.
I20260806 20:32:07.352497 24870 leader_election.cc:302] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d2cdce5ab014334affbbb67c35c9ab7, 5b89d1565a304103ac5c6df9a68d8963; no voters: b949e33aaac5425e901ceb727dbd030e
I20260806 20:32:07.352938 25767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 20:32:07.353098 25767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b949e33aaac5425e901ceb727dbd030e)
I20260806 20:32:07.353157 25773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.344196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:43345 (local address 127.0.0.1:57236)
0806 20:32:07.344876 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.344909 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:07.345062 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:07.347419 (+ 2357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:07.347424 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:07.347450 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:07.347860 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.347875 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.349596 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.349602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.351073 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.351086 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.352367 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.352373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.352539 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.352563 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 20:32:07.352671 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 20:32:07.352820 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":55,"thread_start_us":1884,"threads_started":1}
I20260806 20:32:07.353229 25767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 1 FOLLOWER]: Advancing to term 2
I20260806 20:32:07.353262 25780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.344615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57236 (local address 127.13.149.124:43345)
0806 20:32:07.347079 (+ 2464us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.347085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.347110 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:32:07.347242 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.347245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.347293 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.347403 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:07.348116 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.349450 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.351232 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.352188 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.352364 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.352440 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.352696 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.352848 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":2297,"thread_start_us":2139,"threads_started":1}
I20260806 20:32:07.353899 24912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b89d1565a304103ac5c6df9a68d8963" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" is_pre_election: true
I20260806 20:32:07.355679 25767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } }
I20260806 20:32:07.356081 24912 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b89d1565a304103ac5c6df9a68d8963 in current term 2: Already voted for candidate 4d2cdce5ab014334affbbb67c35c9ab7 in this term.
I20260806 20:32:07.356370 25767 leader_election.cc:288] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 2 election: Requested vote from peers b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615), 5b89d1565a304103ac5c6df9a68d8963 (127.13.149.125:39387)
I20260806 20:32:07.356808 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.356370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44508)
0806 20:32:07.356525 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.356635 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 20:32:07.357033 24574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5b89d1565a304103ac5c6df9a68d8963"
I20260806 20:32:07.357036 24526 leader_election.cc:302] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b89d1565a304103ac5c6df9a68d8963; no voters: 4d2cdce5ab014334affbbb67c35c9ab7, b949e33aaac5425e901ceb727dbd030e
I20260806 20:32:07.357255 24574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 1 FOLLOWER]: Advancing to term 2
I20260806 20:32:07.357892 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.357599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44522)
0806 20:32:07.357728 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.357797 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 20:32:07.358060 24870 leader_election.cc:334] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615): Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
I20260806 20:32:07.359575 24574 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d2cdce5ab014334affbbb67c35c9ab7 in term 2.
I20260806 20:32:07.359745 25769 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 20:32:07.360024 24870 leader_election.cc:302] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d2cdce5ab014334affbbb67c35c9ab7, 5b89d1565a304103ac5c6df9a68d8963; no voters: b949e33aaac5425e901ceb727dbd030e
I20260806 20:32:07.360297 25767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 20:32:07.360714 25767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [term 2 LEADER]: Becoming Leader. State: Replica: 4d2cdce5ab014334affbbb67c35c9ab7, State: Running, Role: LEADER
I20260806 20:32:07.361109 25767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } }
I20260806 20:32:07.362679 25783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d2cdce5ab014334affbbb67c35c9ab7. Latest consensus state: current_term: 2 leader_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:07.363121 25783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:07.363878 25787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:07.367564 25787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:07.368369 25787 catalog_manager.cc:1259] Loaded cluster ID: e9157dd5c9d64ab789e1ac4678fb5c91
I20260806 20:32:07.368470 25787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:07.369684 25787 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:07.370512 25787 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Loaded TSK: 0
I20260806 20:32:07.371340 25787 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:32:07.384654 24893 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:32:07.392024 24893 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:07.396503 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.396068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44528)
0806 20:32:07.396272 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.396365 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 20:32:07.396494 24574 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [term 2 FOLLOWER]: Refusing update from remote peer 4d2cdce5ab014334affbbb67c35c9ab7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 20:32:07.397300 25767 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 20:32:07.397755 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.397360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44532)
0806 20:32:07.397503 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.397592 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 20:32:07.397943 24870 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 -> Peer b949e33aaac5425e901ceb727dbd030e (127.13.149.126:43615): Couldn't send request to peer b949e33aaac5425e901ceb727dbd030e. Status: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 20:32:07.400260 25769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d2cdce5ab014334affbbb67c35c9ab7. Latest consensus state: current_term: 2 leader_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:07.400552 25769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:32:07.402084 25767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:07.402407 25767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:07.405819 25791 mvcc.cc:205] Tried to move back new op lower bound from 7315653949008531456 to 7315653948874334208. Current Snapshot: MvccSnapshot[applied={T|T < 7315653949008531456}]
I20260806 20:32:07.410919 25769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b949e33aaac5425e901ceb727dbd030e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43615 } } peers { permanent_uuid: "5b89d1565a304103ac5c6df9a68d8963" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 39387 } attrs { promote: false } } peers { permanent_uuid: "4d2cdce5ab014334affbbb67c35c9ab7" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 43345 } attrs { promote: false } } }
I20260806 20:32:07.411237 25769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b89d1565a304103ac5c6df9a68d8963 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:32:07.428754 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.416463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:44933 (local address 127.0.0.1:49418)
0806 20:32:07.417154 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.417176 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:07.417307 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:07.421862 (+ 4555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:07.421871 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:07.421912 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:07.422440 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.422456 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.424193 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.424198 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.426421 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.426435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.427873 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.427879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.428061 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.428095 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 20:32:07.428191 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 20:32:07.428341 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":36,"thread_start_us":575,"threads_started":1}
I20260806 20:32:07.429601 25800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.416934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49418 (local address 127.13.149.67:44933)
0806 20:32:07.421393 (+ 4459us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.421402 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.421431 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:32:07.421529 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.421537 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.421642 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.421782 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:07.422692 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.424004 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.426591 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.427425 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.427576 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.427696 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.429120 (+ 1424us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.429283 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4284,"thread_start_us":4129,"threads_started":1}
I20260806 20:32:07.430087 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.415539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35643 (local address 127.0.0.1:39478)
0806 20:32:07.415726 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.415747 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:07.415872 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:07.424204 (+ 8332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:07.424209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:07.424237 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:07.424481 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.424495 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.425691 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.425697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.427540 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.427554 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.429211 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.429219 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.429384 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.429418 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 20:32:07.429518 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:32:07.429671 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":7}
I20260806 20:32:07.430222 25796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.415815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39478 (local address 127.13.149.65:35643)
0806 20:32:07.423890 (+ 8075us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.423896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.423919 (+ 23us) server_negotiation.cc:407] Connection header received
0806 20:32:07.423990 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.423995 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.424070 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.424186 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:07.424688 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.425549 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.427750 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.429017 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.429197 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.429310 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.429562 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.429709 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7915,"thread_start_us":7776,"threads_started":1}
I20260806 20:32:07.430541 25541 tablet_service.cc:1467] Processing CreateTablet for tablet 9469db8f860f4ca79766e4d6b26d827b (DEFAULT_TABLE table=test-table [id=b43810692ce24c56b9839e85d4c9cd6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:07.430763 25771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.416129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46303 (local address 127.0.0.1:41324)
0806 20:32:07.416556 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.416575 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:07.416670 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:07.424408 (+ 7738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:07.424415 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:07.424444 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:07.424873 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.424886 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.426269 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.426275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.428283 (+ 2008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:07.428297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.429960 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.430043 (+ 83us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:07.430265 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.430302 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 20:32:07.430388 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 20:32:07.430535 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306}
I20260806 20:32:07.431069 25541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9469db8f860f4ca79766e4d6b26d827b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:07.431656 25802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.416971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41324 (local address 127.13.149.66:46303)
0806 20:32:07.424068 (+ 7097us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.424076 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.424098 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:32:07.424177 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.424183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.424275 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.424391 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:07.425043 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.426121 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.428479 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.429700 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.431187 (+ 1487us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.431285 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.431328 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.431433 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6964,"thread_start_us":6845,"threads_started":1}
I20260806 20:32:07.432348 25319 tablet_service.cc:1467] Processing CreateTablet for tablet 9469db8f860f4ca79766e4d6b26d827b (DEFAULT_TABLE table=test-table [id=b43810692ce24c56b9839e85d4c9cd6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:07.432847 25319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9469db8f860f4ca79766e4d6b26d827b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:07.436589 25803 tablet_bootstrap.cc:492] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: Bootstrap starting.
I20260806 20:32:07.436947 25097 tablet_service.cc:1467] Processing CreateTablet for tablet 9469db8f860f4ca79766e4d6b26d827b (DEFAULT_TABLE table=test-table [id=b43810692ce24c56b9839e85d4c9cd6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:07.437394 25097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9469db8f860f4ca79766e4d6b26d827b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:07.438472 25803 tablet_bootstrap.cc:654] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:07.438627 25804 tablet_bootstrap.cc:492] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Bootstrap starting.
I20260806 20:32:07.440395 25804 tablet_bootstrap.cc:654] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:07.440441 25803 tablet_bootstrap.cc:492] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: No bootstrap required, opened a new log
I20260806 20:32:07.440547 25803 ts_tablet_manager.cc:1397] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 20:32:07.441596 25803 raft_consensus.cc:348] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.441849 25803 raft_consensus.cc:374] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:07.441954 25803 raft_consensus.cc:729] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a790cb6a2c4acf8a7e0873a226d545, State: Initialized, Role: FOLLOWER
I20260806 20:32:07.442198 25803 consensus_queue.cc:260] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.443120 25803 ts_tablet_manager.cc:1428] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 20:32:07.445494 25804 tablet_bootstrap.cc:492] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: No bootstrap required, opened a new log
I20260806 20:32:07.445680 25804 ts_tablet_manager.cc:1397] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260806 20:32:07.446696 25804 raft_consensus.cc:348] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.447031 25804 raft_consensus.cc:374] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:07.447137 25804 raft_consensus.cc:729] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ff4778fd75408fbabfd75f01bfa30d, State: Initialized, Role: FOLLOWER
I20260806 20:32:07.447511 25804 consensus_queue.cc:260] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.447891 25815 tablet_bootstrap.cc:492] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: Bootstrap starting.
I20260806 20:32:07.448910 25814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.443908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.67:50763)
0806 20:32:07.448365 (+ 4457us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.448554 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4304,"thread_start_us":4185,"threads_started":1}
I20260806 20:32:07.448978 25654 heartbeater.cc:503] Master 127.13.149.124:43345 was elected leader, sending a full tablet report...
I20260806 20:32:07.449646 25804 ts_tablet_manager.cc:1428] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260806 20:32:07.451011 25815 tablet_bootstrap.cc:654] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:07.453970 25818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.450192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.66:57371)
0806 20:32:07.453461 (+ 3269us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.453679 (+ 218us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3129,"thread_start_us":3005,"threads_started":1}
I20260806 20:32:07.454425 25815 tablet_bootstrap.cc:492] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: No bootstrap required, opened a new log
I20260806 20:32:07.454602 25815 ts_tablet_manager.cc:1397] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 20:32:07.454815 25415 heartbeater.cc:503] Master 127.13.149.124:43345 was elected leader, sending a full tablet report...
I20260806 20:32:07.455565 25818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.455183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.66:33419)
0806 20:32:07.455323 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.455424 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 20:32:07.455590 25814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.452007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.67:45393)
0806 20:32:07.455318 (+ 3311us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.455444 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3200}
I20260806 20:32:07.455426 25815 raft_consensus.cc:348] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.455694 25815 raft_consensus.cc:374] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:07.455794 25815 raft_consensus.cc:729] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8383825f834388951a5ece3f8d1da3, State: Initialized, Role: FOLLOWER
I20260806 20:32:07.456032 25815 consensus_queue.cc:260] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.456951 25815 ts_tablet_manager.cc:1428] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 20:32:07.458555 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.457444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.65:40829)
0806 20:32:07.458088 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.458283 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":357,"threads_started":1}
I20260806 20:32:07.459549 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.459178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.65:60965)
0806 20:32:07.459310 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.459396 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 20:32:07.459650 25197 heartbeater.cc:503] Master 127.13.149.124:43345 was elected leader, sending a full tablet report...
I20260806 20:32:07.563920 25813 raft_consensus.cc:482] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:07.564201 25813 raft_consensus.cc:504] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.565162 25813 leader_election.cc:288] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643), b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:07.565724 25122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9469db8f860f4ca79766e4d6b26d827b" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8383825f834388951a5ece3f8d1da3" is_pre_election: true
I20260806 20:32:07.565774 25347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9469db8f860f4ca79766e4d6b26d827b" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" is_pre_election: true
I20260806 20:32:07.566020 25347 raft_consensus.cc:2454] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 0.
I20260806 20:32:07.566025 25122 raft_consensus.cc:2454] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 0.
I20260806 20:32:07.566457 25463 leader_election.cc:302] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78a790cb6a2c4acf8a7e0873a226d545, be8383825f834388951a5ece3f8d1da3; no voters:
I20260806 20:32:07.566707 25813 raft_consensus.cc:2781] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:07.566830 25813 raft_consensus.cc:482] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:07.566926 25813 raft_consensus.cc:3037] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:07.568988 25813 raft_consensus.cc:504] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.569507 25813 leader_election.cc:288] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 election: Requested vote from peers be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643), b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303)
I20260806 20:32:07.569972 25122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9469db8f860f4ca79766e4d6b26d827b" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8383825f834388951a5ece3f8d1da3"
I20260806 20:32:07.570052 25347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9469db8f860f4ca79766e4d6b26d827b" candidate_uuid: "78a790cb6a2c4acf8a7e0873a226d545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4ff4778fd75408fbabfd75f01bfa30d"
I20260806 20:32:07.570206 25122 raft_consensus.cc:3037] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:07.570277 25347 raft_consensus.cc:3037] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:07.573261 25122 raft_consensus.cc:2454] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 1.
I20260806 20:32:07.573261 25347 raft_consensus.cc:2454] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a790cb6a2c4acf8a7e0873a226d545 in term 1.
I20260806 20:32:07.573691 25463 leader_election.cc:302] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 78a790cb6a2c4acf8a7e0873a226d545, b4ff4778fd75408fbabfd75f01bfa30d, be8383825f834388951a5ece3f8d1da3; no voters:
I20260806 20:32:07.574030 25813 raft_consensus.cc:2781] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:07.574492 25813 raft_consensus.cc:686] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 LEADER]: Becoming Leader. State: Replica: 78a790cb6a2c4acf8a7e0873a226d545, State: Running, Role: LEADER
I20260806 20:32:07.574781 25813 consensus_queue.cc:237] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } }
I20260806 20:32:07.575618 25814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.575145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.67:52553)
0806 20:32:07.575320 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.575463 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 20:32:07.577790 24894 catalog_manager.cc:5495] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "78a790cb6a2c4acf8a7e0873a226d545" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78a790cb6a2c4acf8a7e0873a226d545" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 44933 } health_report { overall_health: HEALTHY } } }
W20260806 20:32:07.612979 25424 tablet.cc:2369] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:32:07.614060 25800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.608877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49434 (local address 127.13.149.67:44933)
0806 20:32:07.609079 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.609086 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.609224 (+ 138us) server_negotiation.cc:407] Connection header received
0806 20:32:07.609438 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.609442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.609510 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.609606 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:07.609994 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.610662 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.612104 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.612601 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.612753 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.613373 (+ 620us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:07.613480 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:07.613580 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.613711 (+ 131us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.613795 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 20:32:07.617256 25347 raft_consensus.cc:1261] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Refusing update from remote peer 78a790cb6a2c4acf8a7e0873a226d545: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:07.617918 25122 raft_consensus.cc:1261] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Refusing update from remote peer 78a790cb6a2c4acf8a7e0873a226d545: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:07.618148 25813 consensus_queue.cc:1035] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4ff4778fd75408fbabfd75f01bfa30d" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:07.618619 25822 consensus_queue.cc:1035] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be8383825f834388951a5ece3f8d1da3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:07.620952 25818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.620434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.66:50719)
0806 20:32:07.620656 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.620746 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 20:32:07.621567 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.620928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.65:54013)
0806 20:32:07.621186 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.621357 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 20:32:07.625581 25828 mvcc.cc:205] Tried to move back new op lower bound from 7315653949914062848 to 7315653949748617216. Current Snapshot: MvccSnapshot[applied={T|T < 7315653949914062848}]
I20260806 20:32:07.627671 25814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.627158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.67:50169)
0806 20:32:07.627420 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.627520 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260806 20:32:07.628574 25818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.628118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.66:36653)
0806 20:32:07.628318 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.628414 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 20:32:07.629827 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.629434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.13.149.65:51501)
0806 20:32:07.629596 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.629682 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 20:32:07.631506 25829 mvcc.cc:205] Tried to move back new op lower bound from 7315653949914062848 to 7315653949748617216. Current Snapshot: MvccSnapshot[applied={T|T < 7315653949914062848}]
I20260806 20:32:07.635862 24893 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:07.636133 24893 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:07.642145 24893 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d2cdce5ab014334affbbb67c35c9ab7: Sending DeleteTablet for 3 replicas of tablet 9469db8f860f4ca79766e4d6b26d827b
I20260806 20:32:07.643055 25319 tablet_service.cc:1514] Processing DeleteTablet for tablet 9469db8f860f4ca79766e4d6b26d827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:07 UTC) from {username='oryx', principal='oryx/127.13.149.124@KRBTEST.COM'} at 127.0.0.1:41324
I20260806 20:32:07.643253 25097 tablet_service.cc:1514] Processing DeleteTablet for tablet 9469db8f860f4ca79766e4d6b26d827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:07 UTC) from {username='oryx', principal='oryx/127.13.149.124@KRBTEST.COM'} at 127.0.0.1:39478
I20260806 20:32:07.643502 25541 tablet_service.cc:1514] Processing DeleteTablet for tablet 9469db8f860f4ca79766e4d6b26d827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:07 UTC) from {username='oryx', principal='oryx/127.13.149.124@KRBTEST.COM'} at 127.0.0.1:49418
I20260806 20:32:07.644053 25318 tablet_service.cc:1514] Processing DeleteTablet for tablet 9469db8f860f4ca79766e4d6b26d827b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:07 UTC) from {username='oryx', principal='oryx/127.13.149.124@KRBTEST.COM'} at 127.0.0.1:41324
I20260806 20:32:07.645201 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 24851
I20260806 20:32:07.653779 25841 tablet_replica.cc:330] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: stopping tablet replica
I20260806 20:32:07.654006 25841 raft_consensus.cc:2229] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:32:07.654356 25841 raft_consensus.cc:2258] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:07.655725 25839 tablet_replica.cc:330] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: stopping tablet replica
I20260806 20:32:07.655915 25839 raft_consensus.cc:2229] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:07.656189 25839 raft_consensus.cc:2258] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:07.657243 25841 ts_tablet_manager.cc:1905] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:07.657909 25840 tablet_replica.cc:330] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: stopping tablet replica
I20260806 20:32:07.658095 25840 raft_consensus.cc:2229] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:07.658372 25840 raft_consensus.cc:2258] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:07.660666 25840 ts_tablet_manager.cc:1905] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:07.663983 25841 ts_tablet_manager.cc:1918] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:07.664126 25841 log.cc:1196] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/9469db8f860f4ca79766e4d6b26d827b
I20260806 20:32:07.664623 25841 ts_tablet_manager.cc:1939] T 9469db8f860f4ca79766e4d6b26d827b P 78a790cb6a2c4acf8a7e0873a226d545: Deleting consensus metadata
I20260806 20:32:07.665532 25839 ts_tablet_manager.cc:1905] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:07.665838 24865 catalog_manager.cc:4841] TS 78a790cb6a2c4acf8a7e0873a226d545 (127.13.149.67:44933): tablet 9469db8f860f4ca79766e4d6b26d827b (table test-table [id=b43810692ce24c56b9839e85d4c9cd6d]) successfully deleted
I20260806 20:32:07.667040 25840 ts_tablet_manager.cc:1918] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:07.667193 25840 log.cc:1196] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/9469db8f860f4ca79766e4d6b26d827b
I20260806 20:32:07.667574 25840 ts_tablet_manager.cc:1939] T 9469db8f860f4ca79766e4d6b26d827b P be8383825f834388951a5ece3f8d1da3: Deleting consensus metadata
I20260806 20:32:07.668437 24865 catalog_manager.cc:4841] TS be8383825f834388951a5ece3f8d1da3 (127.13.149.65:35643): tablet 9469db8f860f4ca79766e4d6b26d827b (table test-table [id=b43810692ce24c56b9839e85d4c9cd6d]) successfully deleted
I20260806 20:32:07.671324 25839 ts_tablet_manager.cc:1918] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:07.671491 25839 log.cc:1196] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/9469db8f860f4ca79766e4d6b26d827b
I20260806 20:32:07.671988 25839 ts_tablet_manager.cc:1939] T 9469db8f860f4ca79766e4d6b26d827b P b4ff4778fd75408fbabfd75f01bfa30d: Deleting consensus metadata
I20260806 20:32:07.673060 24864 catalog_manager.cc:4841] TS b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303): tablet 9469db8f860f4ca79766e4d6b26d827b (table test-table [id=b43810692ce24c56b9839e85d4c9cd6d]) successfully deleted
W20260806 20:32:07.673543 24864 catalog_manager.cc:4808] TS b4ff4778fd75408fbabfd75f01bfa30d (127.13.149.66:46303): delete failed for tablet 9469db8f860f4ca79766e4d6b26d827b because the tablet was not found. No further retry: Not found: Tablet not found: 9469db8f860f4ca79766e4d6b26d827b
I20260806 20:32:07.674695 25796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.646698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39490 (local address 127.13.149.65:35643)
0806 20:32:07.646993 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.647003 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.656741 (+ 9738us) server_negotiation.cc:407] Connection header received
0806 20:32:07.656982 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.656988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.657069 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.657174 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:07.658978 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.660031 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.661276 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.661758 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.661912 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.668844 (+ 6932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:07.668861 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:07.668883 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:07.668921 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:07.671762 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:07.672581 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:07.672588 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:07.672590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:07.672710 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:07.673162 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:07.673168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:07.673172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:07.673641 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:07.673933 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.674151 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.674314 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 20:32:07.675303 25191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:07.768253 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 24851
I20260806 20:32:07.800083 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 25218
I20260806 20:32:07.813678 25802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.800962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41332 (local address 127.13.149.66:46303)
0806 20:32:07.801180 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.801184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.801203 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:32:07.801321 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.801325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.801387 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.801471 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:07.802740 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.803418 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.804571 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.805089 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.805178 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.807720 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:07.807734 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:07.807751 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:07.807797 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:07.811044 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:07.811702 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:07.811709 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:07.811711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:07.811821 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:07.812166 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:07.812169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:07.812171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:07.812535 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:07.812762 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.813136 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.813334 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 20:32:07.814342 25404 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:07.825184 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.824765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44540)
0806 20:32:07.824961 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.825041 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 20:32:07.826212 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.825863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44550)
0806 20:32:07.826003 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:07.826085 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 20:32:07.908988 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 25218
I20260806 20:32:07.936740 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 25440
I20260806 20:32:07.949723 25800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:07.937683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49438 (local address 127.13.149.67:44933)
0806 20:32:07.937856 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:07.937861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:07.937883 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:32:07.938052 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:07.938056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:07.938138 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:07.938227 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:07.939590 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.940314 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.941546 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:07.941950 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:07.942056 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:07.944664 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:07.944680 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:07.944699 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:07.944730 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:07.947388 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:07.947981 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:07.947988 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:07.947991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:07.948121 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:07.948424 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:07.948427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:07.948429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:07.948836 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:07.949077 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:07.949318 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 20:32:07.949487 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 20:32:07.950428 25648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:08.081316 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 25440
I20260806 20:32:08.115557 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 24326
I20260806 20:32:08.116657 24608 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:08.223454 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:08.223011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44564)
0806 20:32:08.223190 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:08.223303 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 20:32:08.224462 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:08.224158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:43615 (local address 127.0.0.1:44572)
0806 20:32:08.224287 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:08.224353 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:43615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 20:32:08.237075 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 24326
I20260806 20:32:08.271082 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 24484
I20260806 20:32:08.272207 24943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:08.397447 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 24484
2026-08-06T20:32:08Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9973 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:32:08 dist-test-slave-2kcd krb5kdc[25858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:32:08 dist-test-slave-2kcd krb5kdc[25858](info): set up 2 sockets
Aug 06 20:32:08 dist-test-slave-2kcd krb5kdc[25858](info): commencing operation
krb5kdc: starting...
W20260806 20:32:09.738251 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:32:09 dist-test-slave-2kcd krb5kdc[25858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:32:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:32:09Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab.
Entry for principal oryx/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab.
I20260806 20:32:09.986266 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44347
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab
--principal=oryx/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:35097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:44347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:10.316901 25888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:10.317181 25888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:10.317349 25888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:10.324455 25888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:10.324544 25888 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 20:32:10.324636 25888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:10.324738 25888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:10.324848 25888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:10.324946 25888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:10.334632 25888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:35097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:44347
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.126.keytab
--principal=oryx/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:10.335829 25888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:10.337205 25888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:10.348966 25898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:10.348878 25907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:10.349346 25897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:10.349941 25888 server_base.cc:1034] running on GCE node
I20260806 20:32:10.350682 25888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:10.351925 25888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:10.353181 25888 hybrid_clock.cc:648] HybridClock initialized: now 1786048330353114 us; error 39 us; skew 500 ppm
I20260806 20:32:10.353513 25888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:10 dist-test-slave-2kcd krb5kdc[25858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048330, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:10.356498 25888 init.cc:377] Logged in from keytab as oryx/127.13.149.126@KRBTEST.COM (short username oryx)
I20260806 20:32:10.357930 25888 webserver.cc:460] Webserver started at http://127.13.149.126:42521/ using document root <none> and password file <none>
I20260806 20:32:10.358570 25888 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:10.358654 25888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:10.358908 25888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:10.361755 25888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "ee35f9a0cdac4d41831f05d5efc872f7"
format_stamp: "Formatted at 2026-08-06 20:32:10 on dist-test-slave-2kcd"
server_key: "8f2693a9fc43697f5dbf5be63083daa5"
server_key_iv: "a168da30745735532e2ab5a2d3972df9"
server_key_version: "encryptionkey@0"
I20260806 20:32:10.362488 25888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "ee35f9a0cdac4d41831f05d5efc872f7"
format_stamp: "Formatted at 2026-08-06 20:32:10 on dist-test-slave-2kcd"
server_key: "8f2693a9fc43697f5dbf5be63083daa5"
server_key_iv: "a168da30745735532e2ab5a2d3972df9"
server_key_version: "encryptionkey@0"
I20260806 20:32:10.367322 25888 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 20:32:10.370545 25915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:10.371765 25888 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 20:32:10.371939 25888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "ee35f9a0cdac4d41831f05d5efc872f7"
format_stamp: "Formatted at 2026-08-06 20:32:10 on dist-test-slave-2kcd"
server_key: "8f2693a9fc43697f5dbf5be63083daa5"
server_key_iv: "a168da30745735532e2ab5a2d3972df9"
server_key_version: "encryptionkey@0"
I20260806 20:32:10.372141 25888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:10.389998 25888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:10.394394 25888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:10.394716 25888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:10.416355 25888 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:44347
I20260806 20:32:10.416390 26024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:44347 every 8 connection(s)
I20260806 20:32:10.417753 25888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:32:10.419512 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 25888
I20260806 20:32:10.419734 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:32:10.420408 13909 external_mini_cluster.cc:1428] Setting key a50cb983d6694355779571cc1aa9f08f
I20260806 20:32:10.423308 26025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 20:32:10 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:10.436568 26025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Bootstrap starting.
I20260806 20:32:10.439694 26025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:10.440718 26025 log.cc:824] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:10.443177 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:10.422447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43348 (local address 127.13.149.126:44347)
0806 20:32:10.423112 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:10.423125 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:10.423165 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:32:10.424897 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:10.424919 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:10.425301 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:10.425627 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:10.427514 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:10.428960 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:10.430701 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:10.431333 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:10.431459 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:10.436052 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:10.436060 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:10.436074 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:10.436112 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:10.439094 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:10.439775 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:10.439782 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:10.439788 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:10.439991 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:10.440372 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:10.440378 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:10.440381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:10.441022 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:10.441320 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:10.441806 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 20:32:10.442244 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":277,"threads_started":1}
I20260806 20:32:10.443575 26025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: No bootstrap required, opened a new log
I20260806 20:32:10.450634 26025 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44347 } }
I20260806 20:32:10.450989 26025 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:10.451121 26025 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee35f9a0cdac4d41831f05d5efc872f7, State: Initialized, Role: FOLLOWER
I20260806 20:32:10.451713 26025 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44347 } }
I20260806 20:32:10.451933 26025 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:32:10.452087 26025 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:32:10.452261 26025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:10.454681 26025 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44347 } }
I20260806 20:32:10.455168 26025 leader_election.cc:302] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee35f9a0cdac4d41831f05d5efc872f7; no voters:
I20260806 20:32:10.455727 26025 leader_election.cc:288] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:32:10.455891 26032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:10.456629 26032 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [term 1 LEADER]: Becoming Leader. State: Replica: ee35f9a0cdac4d41831f05d5efc872f7, State: Running, Role: LEADER
I20260806 20:32:10.457203 26032 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44347 } }
I20260806 20:32:10.457860 26025 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:10.459862 26034 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee35f9a0cdac4d41831f05d5efc872f7. Latest consensus state: current_term: 1 leader_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44347 } } }
I20260806 20:32:10.460184 26034 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:10.461316 26033 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee35f9a0cdac4d41831f05d5efc872f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44347 } } }
I20260806 20:32:10.462061 26033 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:10.462291 26045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:10.466691 26045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:10.476895 26045 catalog_manager.cc:1347] Generated new cluster ID: 475edfbf346c4a30add8edc0203a2b48
I20260806 20:32:10.477023 26045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:10.492237 26045 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:32:10.494136 26045 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:10.509572 26045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Generated new TSK 0
I20260806 20:32:10.510527 26045 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab.
Entry for principal oryx/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab.
I20260806 20:32:10.586305 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44347
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab
--principal=oryx/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:35097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:10.934849 26073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:10.935142 26073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:10.935317 26073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:10.942574 26073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:10.942721 26073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:10.942863 26073 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:32:10.942994 26073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:10.952710 26073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:35097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab
--principal=oryx/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:10.954017 26073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:10.955385 26073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:10.968909 26081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:10.969009 26085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:10.968981 26082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:10.969781 26073 server_base.cc:1034] running on GCE node
I20260806 20:32:10.970410 26073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:10.971334 26073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:10.972580 26073 hybrid_clock.cc:648] HybridClock initialized: now 1786048330972517 us; error 40 us; skew 500 ppm
I20260806 20:32:10.972941 26073 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:10 dist-test-slave-2kcd krb5kdc[25858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048330, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:10.976150 26073 init.cc:377] Logged in from keytab as oryx/127.13.149.65@KRBTEST.COM (short username oryx)
I20260806 20:32:10.977699 26073 webserver.cc:460] Webserver started at http://127.13.149.65:36915/ using document root <none> and password file <none>
I20260806 20:32:10.978402 26073 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:10.978528 26073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:10.978860 26073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:10.981841 26073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "3aa3930dab4243b89286ea9e7a52e643"
format_stamp: "Formatted at 2026-08-06 20:32:10 on dist-test-slave-2kcd"
server_key: "b7a32edc3ee31de4ac7a5ca09cd0a581"
server_key_iv: "b0a3b4d33f6062aaaf0d4d45e5cb9709"
server_key_version: "encryptionkey@0"
I20260806 20:32:10.982722 26073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "3aa3930dab4243b89286ea9e7a52e643"
format_stamp: "Formatted at 2026-08-06 20:32:10 on dist-test-slave-2kcd"
server_key: "b7a32edc3ee31de4ac7a5ca09cd0a581"
server_key_iv: "b0a3b4d33f6062aaaf0d4d45e5cb9709"
server_key_version: "encryptionkey@0"
I20260806 20:32:10.987816 26073 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:32:10.991235 26095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:10.992533 26073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:10.992704 26073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "3aa3930dab4243b89286ea9e7a52e643"
format_stamp: "Formatted at 2026-08-06 20:32:10 on dist-test-slave-2kcd"
server_key: "b7a32edc3ee31de4ac7a5ca09cd0a581"
server_key_iv: "b0a3b4d33f6062aaaf0d4d45e5cb9709"
server_key_version: "encryptionkey@0"
I20260806 20:32:10.992975 26073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:11.015638 26073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:11.019687 26073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:11.019968 26073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:11.022675 26073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:11.022789 26073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:11.022950 26073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:11.023034 26073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:32:11 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048330, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:11.049590 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.023471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:47859 (local address 127.13.149.126:44347)
0806 20:32:11.025100 (+ 1629us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:11.025109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:11.025945 (+ 836us) server_negotiation.cc:407] Connection header received
0806 20:32:11.028928 (+ 2983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:11.028934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:11.029028 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:11.029127 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:11.031791 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.033439 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.035429 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.036176 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.036326 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.041069 (+ 4743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:11.041076 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:11.041081 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:11.041128 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:11.044776 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.045675 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.045683 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.045690 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.045876 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.046528 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.046537 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.046541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.046944 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:11.047096 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:11.048989 (+ 1893us) server_negotiation.cc:299] Negotiation successful
0806 20:32:11.049232 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1460,"thread_start_us":1331,"threads_started":1}
I20260806 20:32:11.049602 26111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.024084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44347 (local address 127.13.149.65:47859)
0806 20:32:11.025746 (+ 1662us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:11.025802 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:11.028549 (+ 2747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:11.029425 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:11.029441 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:11.030406 (+ 965us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:11.031570 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.031602 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.033709 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.033720 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.035267 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.035281 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.036398 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.036403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.036592 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.037353 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:11.037404 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:11.040709 (+ 3305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:11.045020 (+ 4311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.045034 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.045053 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.045553 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.046030 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.046038 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.046045 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.046354 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.047072 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:11.047080 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:11.047474 (+ 394us) client_negotiation.cc:769] Sending connection context
0806 20:32:11.047876 (+ 402us) client_negotiation.cc:240] Negotiation successful
0806 20:32:11.048269 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1355,"thread_start_us":1066,"threads_started":1}
I20260806 20:32:11.077032 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.060698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:50141 (local address 127.13.149.126:44347)
0806 20:32:11.060968 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:11.060977 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:11.061699 (+ 722us) server_negotiation.cc:407] Connection header received
0806 20:32:11.062017 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:11.062026 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:11.062136 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:11.062262 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:11.063208 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.064656 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.066394 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.067366 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.067533 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.069486 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:11.069496 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:11.069512 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:11.069565 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:11.073796 (+ 4231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.074603 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.074610 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.074613 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.074783 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.075233 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.075238 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.075242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.075655 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:11.075821 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:11.076388 (+ 567us) server_negotiation.cc:299] Negotiation successful
0806 20:32:11.076622 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260806 20:32:11.077165 26208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.060760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44347 (local address 127.13.149.65:50141)
0806 20:32:11.061578 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:11.061601 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:11.061820 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:11.062322 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:11.062326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:11.062775 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:11.063066 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.063075 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.064855 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.064863 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.066242 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.066255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.067550 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.067554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.067681 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.068406 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:11.068423 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:11.069274 (+ 851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:11.073940 (+ 4666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.073944 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.073947 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.074383 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.074922 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.074931 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.074934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.075109 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.075776 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:11.075782 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:11.076048 (+ 266us) client_negotiation.cc:769] Sending connection context
0806 20:32:11.076265 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 20:32:11.076627 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":437,"threads_started":1}
I20260806 20:32:11.095960 26073 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:34907
I20260806 20:32:11.096010 26295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:34907 every 8 connection(s)
I20260806 20:32:11.097415 26073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:11.099522 26299 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44347
I20260806 20:32:11.099714 26299 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:11.100318 26299 heartbeater.cc:511] Master 127.13.149.126:44347 requested a full tablet report, sending...
I20260806 20:32:11.102274 25943 ts_manager.cc:194] Registered new tserver with Master: 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907)
I20260806 20:32:11.103710 25943 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:47859
I20260806 20:32:11.106377 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 26073
I20260806 20:32:11.106542 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:32:11.107172 13909 external_mini_cluster.cc:1428] Setting key 9d8904f614c937ce8650768ab6fa8fab
WARNING: no policy specified for oryx/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab.
Entry for principal oryx/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab.
I20260806 20:32:11.163811 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44347
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab
--principal=oryx/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:35097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:11.495352 26304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:11.495687 26304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:11.495851 26304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:11.503259 26304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:11.503398 26304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:11.503561 26304 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:32:11.503700 26304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:11.514360 26304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:35097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab
--principal=oryx/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:11.515578 26304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:11.516983 26304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:11.529827 26311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:11.529855 26312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:11.529887 26320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:11.530794 26304 server_base.cc:1034] running on GCE node
I20260806 20:32:11.531368 26304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:11.532224 26304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:11.533453 26304 hybrid_clock.cc:648] HybridClock initialized: now 1786048331533376 us; error 57 us; skew 500 ppm
I20260806 20:32:11.533741 26304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:11 dist-test-slave-2kcd krb5kdc[25858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048331, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:11.536844 26304 init.cc:377] Logged in from keytab as oryx/127.13.149.66@KRBTEST.COM (short username oryx)
I20260806 20:32:11.538297 26304 webserver.cc:460] Webserver started at http://127.13.149.66:40691/ using document root <none> and password file <none>
I20260806 20:32:11.538949 26304 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:11.539049 26304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:11.539325 26304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:11.542274 26304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "22c29dd047b341fda188deb420720bf7"
format_stamp: "Formatted at 2026-08-06 20:32:11 on dist-test-slave-2kcd"
server_key: "8b246fd8989dd912f4ec16a484eac2a1"
server_key_iv: "a049fb25fb0e065d43bf9fe5e5eb9fde"
server_key_version: "encryptionkey@0"
I20260806 20:32:11.543036 26304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "22c29dd047b341fda188deb420720bf7"
format_stamp: "Formatted at 2026-08-06 20:32:11 on dist-test-slave-2kcd"
server_key: "8b246fd8989dd912f4ec16a484eac2a1"
server_key_iv: "a049fb25fb0e065d43bf9fe5e5eb9fde"
server_key_version: "encryptionkey@0"
I20260806 20:32:11.548062 26304 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:32:11.551522 26331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:11.552899 26304 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:32:11.553071 26304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "22c29dd047b341fda188deb420720bf7"
format_stamp: "Formatted at 2026-08-06 20:32:11 on dist-test-slave-2kcd"
server_key: "8b246fd8989dd912f4ec16a484eac2a1"
server_key_iv: "a049fb25fb0e065d43bf9fe5e5eb9fde"
server_key_version: "encryptionkey@0"
I20260806 20:32:11.553260 26304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:11.571843 26304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:11.575683 26304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:11.576007 26304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:11.578847 26304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:11.578958 26304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:11.579137 26304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:11.579268 26304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 06 20:32:11 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048331, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:11.601020 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.579291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:60623 (local address 127.13.149.126:44347)
0806 20:32:11.579761 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:11.579768 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:11.580988 (+ 1220us) server_negotiation.cc:407] Connection header received
0806 20:32:11.583331 (+ 2343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:11.583336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:11.583425 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:11.583556 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:11.585713 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.587106 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.588882 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.589676 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.589830 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.594459 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:11.594467 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:11.594472 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:11.594523 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:11.597798 (+ 3275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.598720 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.598730 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.598733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.598849 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.599297 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.599302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.599305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.599562 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:11.599725 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:11.600382 (+ 657us) server_negotiation.cc:299] Negotiation successful
0806 20:32:11.600603 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":239,"threads_started":1}
I20260806 20:32:11.602123 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.579886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44347 (local address 127.13.149.66:60623)
0806 20:32:11.580819 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:11.580869 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:11.583055 (+ 2186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:11.583791 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:11.583803 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:11.584576 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:11.585467 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.585496 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.587280 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.587284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.588609 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.588624 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.589959 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.589968 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.590309 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.591002 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:11.591028 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:11.594235 (+ 3207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:11.597937 (+ 3702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.597948 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.597967 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.598596 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.598964 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.598969 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.598972 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.599167 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.599688 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:11.599696 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:11.600037 (+ 341us) client_negotiation.cc:769] Sending connection context
0806 20:32:11.600282 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 20:32:11.600766 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":380,"threads_started":1}
I20260806 20:32:11.620683 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.608298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:33341 (local address 127.13.149.126:44347)
0806 20:32:11.608478 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:11.608482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:11.609409 (+ 927us) server_negotiation.cc:407] Connection header received
0806 20:32:11.609587 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:11.609592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:11.609660 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:11.609751 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:11.610627 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.611297 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.612541 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.613018 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.613160 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.614754 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:11.614760 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:11.614769 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:11.614797 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:11.617798 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.618613 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.618620 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.618636 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.618780 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:11.619267 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:11.619274 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:11.619276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:11.619635 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:11.619797 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:11.620339 (+ 542us) server_negotiation.cc:299] Negotiation successful
0806 20:32:11.620490 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 20:32:11.621333 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:11.608481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44347 (local address 127.13.149.66:33341)
0806 20:32:11.609315 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:11.609333 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:11.609466 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:11.609775 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:11.609779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:11.610225 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:11.610494 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.610503 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.611425 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.611431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.612404 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:11.612415 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:11.613206 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:11.613212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:11.613377 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:11.613913 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:11.613930 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:11.614565 (+ 635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:11.617920 (+ 3355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.617925 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.617929 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.618473 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.618917 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:11.618923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:11.618933 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:11.619120 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:11.619761 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:11.619769 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:11.620056 (+ 287us) client_negotiation.cc:769] Sending connection context
0806 20:32:11.620261 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 20:32:11.620703 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":442,"threads_started":1}
I20260806 20:32:11.636324 26304 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:39429
I20260806 20:32:11.636370 26542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:39429 every 8 connection(s)
I20260806 20:32:11.637576 26304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:11.639307 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 26304
I20260806 20:32:11.639509 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:32:11.639686 26543 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44347
I20260806 20:32:11.639919 26543 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:11.640056 13909 external_mini_cluster.cc:1428] Setting key a10e45f2b2b7f338dec63c8eaec0e88b
I20260806 20:32:11.640583 26543 heartbeater.cc:511] Master 127.13.149.126:44347 requested a full tablet report, sending...
I20260806 20:32:11.641993 25943 ts_manager.cc:194] Registered new tserver with Master: 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429)
I20260806 20:32:11.642800 25943 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:60623
WARNING: no policy specified for oryx/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab.
Entry for principal oryx/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab.
I20260806 20:32:11.693936 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44347
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab
--principal=oryx/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:35097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:12.023973 26548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:12.024266 26548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:12.024425 26548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:12.031414 26548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:12.031565 26548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:12.031697 26548 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 20:32:12.031823 26548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:12.041322 26548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:35097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab
--principal=oryx/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.149.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:12.042558 26548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:12.043877 26548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:12.056710 26556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:12.056768 26555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:12.056768 26561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:12.058072 26548 server_base.cc:1034] running on GCE node
I20260806 20:32:12.058758 26548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:12.059667 26548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:12.060894 26548 hybrid_clock.cc:648] HybridClock initialized: now 1786048332060838 us; error 34 us; skew 500 ppm
I20260806 20:32:12.061151 26548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:12 dist-test-slave-2kcd krb5kdc[25858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048332, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:12.064301 26548 init.cc:377] Logged in from keytab as oryx/127.13.149.67@KRBTEST.COM (short username oryx)
I20260806 20:32:12.065748 26548 webserver.cc:460] Webserver started at http://127.13.149.67:41979/ using document root <none> and password file <none>
I20260806 20:32:12.066411 26548 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:12.066504 26548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:12.066773 26548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:12.069872 26548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "9addfbcab2414f789cc86a242049dd49"
format_stamp: "Formatted at 2026-08-06 20:32:12 on dist-test-slave-2kcd"
server_key: "d58ad1ce6e68760bb02a56ed1af22e54"
server_key_iv: "eb508ce616b965971c96da68d05405d0"
server_key_version: "encryptionkey@0"
I20260806 20:32:12.070626 26548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "9addfbcab2414f789cc86a242049dd49"
format_stamp: "Formatted at 2026-08-06 20:32:12 on dist-test-slave-2kcd"
server_key: "d58ad1ce6e68760bb02a56ed1af22e54"
server_key_iv: "eb508ce616b965971c96da68d05405d0"
server_key_version: "encryptionkey@0"
I20260806 20:32:12.075731 26548 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:32:12.079113 26575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:12.080422 26548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:12.080552 26548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "9addfbcab2414f789cc86a242049dd49"
format_stamp: "Formatted at 2026-08-06 20:32:12 on dist-test-slave-2kcd"
server_key: "d58ad1ce6e68760bb02a56ed1af22e54"
server_key_iv: "eb508ce616b965971c96da68d05405d0"
server_key_version: "encryptionkey@0"
I20260806 20:32:12.080744 26548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:12.106398 26299 heartbeater.cc:503] Master 127.13.149.126:44347 was elected leader, sending a full tablet report...
I20260806 20:32:12.112154 26548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:12.116590 26548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:12.116906 26548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:12.119521 26548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:12.119632 26548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:12.119781 26548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:12.119856 26548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:32:12 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048332, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:12.146689 26588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.120945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44347 (local address 127.13.149.67:50073)
0806 20:32:12.121834 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.121893 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.124746 (+ 2853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.125725 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.125739 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.126587 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:12.127796 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.127836 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.129692 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.129699 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.131885 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.131898 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.133370 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.133379 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.133681 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.134541 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:12.134572 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:12.137671 (+ 3099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:12.142065 (+ 4394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:12.142080 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:12.142103 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:12.142943 (+ 840us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:12.143442 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:12.143451 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:12.143458 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:12.143794 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:12.144393 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:12.144404 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:12.144752 (+ 348us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.145207 (+ 455us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.145627 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":357,"threads_started":1}
I20260806 20:32:12.147855 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.120346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:50073 (local address 127.13.149.126:44347)
0806 20:32:12.120538 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.120545 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.122028 (+ 1483us) server_negotiation.cc:407] Connection header received
0806 20:32:12.125157 (+ 3129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.125163 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.125268 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.125417 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:12.128072 (+ 2655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.129535 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.132037 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.132859 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.133013 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.137998 (+ 4985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:12.138005 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:12.138013 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:12.138047 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:12.141859 (+ 3812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.143081 (+ 1222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.143089 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.143095 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.143280 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.143940 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.143944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.143946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.144225 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:12.144380 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.147270 (+ 2890us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.147554 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 20:32:12.178013 26548 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:32891
I20260806 20:32:12.178133 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.153221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:55881 (local address 127.13.149.126:44347)
0806 20:32:12.153390 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.153415 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.163535 (+ 10120us) server_negotiation.cc:407] Connection header received
0806 20:32:12.163730 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.163738 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.163830 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.163941 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:12.165722 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.166677 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.168383 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.169092 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.169238 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.171883 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:12.171887 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:12.171890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:12.171919 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:12.175300 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.176066 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.176071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.176076 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.176235 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.176595 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.176601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.176605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.176944 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:12.177094 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.177527 (+ 433us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.177759 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 20:32:12.178421 26691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.153389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44347 (local address 127.13.149.67:55881)
0806 20:32:12.163411 (+ 10022us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.163430 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.163599 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.164001 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.164013 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.164804 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:12.165530 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.165552 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.166839 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.166847 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.168243 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.168262 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.169517 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.169522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.169659 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.170433 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:12.170450 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:12.171637 (+ 1187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:12.175434 (+ 3797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:12.175439 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:12.175443 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:12.175932 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:12.176348 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:12.176354 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:12.176357 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:12.176488 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:12.177072 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:12.177077 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:12.177276 (+ 199us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.177428 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.177791 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9887,"thread_start_us":9756,"threads_started":1}
I20260806 20:32:12.179798 26548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:12.178056 26774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:32891 every 8 connection(s)
I20260806 20:32:12.182413 26775 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44347
I20260806 20:32:12.182652 26775 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:12.183290 26775 heartbeater.cc:511] Master 127.13.149.126:44347 requested a full tablet report, sending...
I20260806 20:32:12.184623 25943 ts_manager.cc:194] Registered new tserver with Master: 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:12.185519 25943 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:50073
I20260806 20:32:12.188964 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 26548
I20260806 20:32:12.189136 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:32:12.189565 13909 external_mini_cluster.cc:1428] Setting key ffa0fbe444425c219a007cc730d8047e
I20260806 20:32:12.192452 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 20:32:12 dist-test-slave-2kcd krb5kdc[25858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048332, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 20:32:12 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:12 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 20:32:12.253748 26349 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:12.242290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43350 (local address 127.13.149.126:44347)
0806 20:32:12.242572 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.242581 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.242718 (+ 137us) server_negotiation.cc:407] Connection header received
0806 20:32:12.242876 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.242881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.242947 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.243037 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:12.244393 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.245232 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.246430 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.246839 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.246934 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.253416 (+ 6482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43350: BlockingRecv error: recv got EOF from 127.0.0.1:43350 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 06 20:32:12 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048332, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:12.272053 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.258331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43360 (local address 127.13.149.126:44347)
0806 20:32:12.258555 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.258562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.258916 (+ 354us) server_negotiation.cc:407] Connection header received
0806 20:32:12.259190 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.259196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.259270 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.259375 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:12.260530 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.261346 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.262550 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.263029 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.263161 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.267149 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:12.267154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:12.267158 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:12.267192 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:12.269730 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.270362 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.270366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.270368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.270504 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.270808 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.270811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.270813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.271069 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:12.271266 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.271518 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.271688 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 20:32:12.276252 25943 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:32:12.283357 25943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:12.306727 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.295989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:32891 (local address 127.0.0.1:50266)
0806 20:32:12.296984 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.297000 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.297106 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.298475 (+ 1369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.298479 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.298509 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:12.298985 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.298996 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.301316 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.301321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.303529 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.303538 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.305531 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.305541 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.305806 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.305881 (+ 75us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.306017 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.306250 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":872,"mutex_wait_us":6,"thread_start_us":1223,"threads_started":1}
I20260806 20:32:12.308051 26804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.295394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:34907 (local address 127.0.0.1:59596)
0806 20:32:12.296640 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.296696 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.297061 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.298196 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.298203 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.298233 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:12.298769 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.298782 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.300845 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.300850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.303490 (+ 2640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.303519 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.307215 (+ 3696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.307222 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.307399 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.307445 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.307529 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.307651 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"mutex_wait_us":1,"thread_start_us":792,"threads_started":1}
I20260806 20:32:12.308395 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.296274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50266 (local address 127.13.149.67:32891)
0806 20:32:12.297872 (+ 1598us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.297880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.297908 (+ 28us) server_negotiation.cc:407] Connection header received
0806 20:32:12.298017 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.298024 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.298242 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.299218 (+ 976us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:12.299569 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.301153 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.303734 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.305272 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.307548 (+ 2276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.307782 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.307862 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.308066 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1406,"thread_start_us":1546,"threads_started":1}
I20260806 20:32:12.309253 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.295717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59596 (local address 127.13.149.65:34907)
0806 20:32:12.296523 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.296532 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.296849 (+ 317us) server_negotiation.cc:407] Connection header received
0806 20:32:12.297369 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.297380 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.297680 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.297871 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:12.299001 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.300648 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.303703 (+ 3055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.306476 (+ 2773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.306628 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.308633 (+ 2005us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.308719 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.308928 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":692,"threads_started":1}
I20260806 20:32:12.312191 26659 tablet_service.cc:1467] Processing CreateTablet for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf (DEFAULT_TABLE table=test-table [id=819b78778d09473790a737bab036eb21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:12.312678 26181 tablet_service.cc:1467] Processing CreateTablet for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf (DEFAULT_TABLE table=test-table [id=819b78778d09473790a737bab036eb21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:12.313791 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.313964 26181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.316497 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.297169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:39429 (local address 127.0.0.1:36960)
0806 20:32:12.307250 (+ 10081us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.307267 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.307379 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.309725 (+ 2346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.309730 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.309757 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:12.309929 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.309942 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.311729 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.311734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.313537 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.313564 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.315724 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.315730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.315907 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.315938 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.316050 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.316207 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9980,"thread_start_us":11802,"threads_started":1}
I20260806 20:32:12.316597 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.297497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36960 (local address 127.13.149.66:39429)
0806 20:32:12.308217 (+ 10720us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.308229 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.308269 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:32:12.308392 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.308403 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.309454 (+ 1051us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.309757 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:12.310105 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.311576 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.313725 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.315537 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.315691 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.315900 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.316121 (+ 221us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.316285 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10482,"thread_start_us":11097,"threads_started":1}
I20260806 20:32:12.320309 26429 tablet_service.cc:1467] Processing CreateTablet for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf (DEFAULT_TABLE table=test-table [id=819b78778d09473790a737bab036eb21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:12.321784 26429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.326622 26817 tablet_bootstrap.cc:492] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Bootstrap starting.
I20260806 20:32:12.328593 26818 tablet_bootstrap.cc:492] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Bootstrap starting.
I20260806 20:32:12.332196 26818 tablet_bootstrap.cc:654] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.332198 26817 tablet_bootstrap.cc:654] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.333607 26818 log.cc:824] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:12.333607 26817 log.cc:824] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:12.336092 26822 tablet_bootstrap.cc:492] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Bootstrap starting.
I20260806 20:32:12.337522 26818 tablet_bootstrap.cc:492] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: No bootstrap required, opened a new log
I20260806 20:32:12.337618 26817 tablet_bootstrap.cc:492] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: No bootstrap required, opened a new log
I20260806 20:32:12.337827 26818 ts_tablet_manager.cc:1397] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 20:32:12.337865 26817 ts_tablet_manager.cc:1397] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260806 20:32:12.339701 26822 tablet_bootstrap.cc:654] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.341010 26822 log.cc:824] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:12.344573 26822 tablet_bootstrap.cc:492] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: No bootstrap required, opened a new log
I20260806 20:32:12.344901 26822 ts_tablet_manager.cc:1397] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260806 20:32:12.345999 26817 raft_consensus.cc:348] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.346382 26817 raft_consensus.cc:374] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.346484 26817 raft_consensus.cc:729] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9addfbcab2414f789cc86a242049dd49, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.347100 26817 consensus_queue.cc:260] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.348131 26818 raft_consensus.cc:348] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.348539 26818 raft_consensus.cc:374] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.348654 26818 raft_consensus.cc:729] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.349260 26818 consensus_queue.cc:260] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.357525 26775 heartbeater.cc:503] Master 127.13.149.126:44347 was elected leader, sending a full tablet report...
I20260806 20:32:12.357841 26822 raft_consensus.cc:348] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.358311 26822 raft_consensus.cc:374] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.358426 26822 raft_consensus.cc:729] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c29dd047b341fda188deb420720bf7, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.358458 26817 ts_tablet_manager.cc:1428] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Time spent starting tablet: real 0.020s user 0.009s sys 0.012s
I20260806 20:32:12.359150 26818 ts_tablet_manager.cc:1428] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Time spent starting tablet: real 0.021s user 0.016s sys 0.004s
I20260806 20:32:12.359020 26822 consensus_queue.cc:260] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.360713 26543 heartbeater.cc:503] Master 127.13.149.126:44347 was elected leader, sending a full tablet report...
I20260806 20:32:12.361405 26822 ts_tablet_manager.cc:1428] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Time spent starting tablet: real 0.016s user 0.011s sys 0.005s
W20260806 20:32:12.389560 26544 tablet.cc:2369] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:32:12.431653 26777 tablet.cc:2369] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:32:12.500123 26826 raft_consensus.cc:482] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:12.500505 26826 raft_consensus.cc:504] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.502537 26826 leader_election.cc:288] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:12.510720 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.503289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:45649 (local address 127.13.149.67:32891)
0806 20:32:12.503617 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.503626 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.503651 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:32:12.503811 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.503817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.503914 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.504018 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:12.505232 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.506345 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.508507 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.509663 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.509854 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.509930 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.510311 (+ 381us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.510454 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260806 20:32:12.511265 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.502793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:32891 (local address 127.13.149.65:45649)
0806 20:32:12.503514 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.503531 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.503655 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.504232 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.504237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.504282 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:12.505005 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.505021 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.506460 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.506475 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.508357 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.508376 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.509899 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.509907 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.510118 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.510167 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.510285 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.510457 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":14,"thread_start_us":380,"threads_started":1}
I20260806 20:32:12.511703 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.503829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:35355 (local address 127.13.149.66:39429)
0806 20:32:12.504041 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.504048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.504068 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:32:12.504149 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.504156 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.504241 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.504356 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:12.505234 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.506501 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.509476 (+ 2975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.510575 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.510730 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.510809 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.511318 (+ 509us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.511445 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:32:12.511828 26836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.503022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:39429 (local address 127.13.149.65:35355)
0806 20:32:12.503795 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.503814 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.503938 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.504388 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.504392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.504433 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:12.505077 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.505089 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.506713 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.506724 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.509245 (+ 2521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.509264 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.510974 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.510980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.511108 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.511143 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.511292 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.511413 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":26,"thread_start_us":1501,"threads_started":1}
I20260806 20:32:12.512719 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59fc12bbcff4baa874d6f1c8fdb4cdf" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49" is_pre_election: true
I20260806 20:32:12.512717 26471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59fc12bbcff4baa874d6f1c8fdb4cdf" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c29dd047b341fda188deb420720bf7" is_pre_election: true
I20260806 20:32:12.513320 26696 raft_consensus.cc:2454] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 0.
I20260806 20:32:12.513347 26471 raft_consensus.cc:2454] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 0.
I20260806 20:32:12.514036 26096 leader_election.cc:302] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3aa3930dab4243b89286ea9e7a52e643, 9addfbcab2414f789cc86a242049dd49; no voters:
I20260806 20:32:12.514496 26826 raft_consensus.cc:2781] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:12.514685 26826 raft_consensus.cc:482] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:12.514827 26826 raft_consensus.cc:3037] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:12.518752 26826 raft_consensus.cc:504] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.519726 26826 leader_election.cc:288] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 election: Requested vote from peers 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:12.519912 26471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59fc12bbcff4baa874d6f1c8fdb4cdf" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c29dd047b341fda188deb420720bf7"
I20260806 20:32:12.520130 26471 raft_consensus.cc:3037] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:12.521143 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a59fc12bbcff4baa874d6f1c8fdb4cdf" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49"
I20260806 20:32:12.521358 26696 raft_consensus.cc:3037] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:12.522751 26471 raft_consensus.cc:2454] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 1.
I20260806 20:32:12.523155 26101 leader_election.cc:302] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 3aa3930dab4243b89286ea9e7a52e643; no voters:
I20260806 20:32:12.523447 26826 raft_consensus.cc:2781] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:12.523909 26826 raft_consensus.cc:686] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 1 LEADER]: Becoming Leader. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Running, Role: LEADER
I20260806 20:32:12.524446 26696 raft_consensus.cc:2454] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 1.
I20260806 20:32:12.524653 26826 consensus_queue.cc:237] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.529207 25942 catalog_manager.cc:5495] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260806 20:32:12.559926 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.554389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59610 (local address 127.13.149.65:34907)
0806 20:32:12.554614 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.554621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.554655 (+ 34us) server_negotiation.cc:407] Connection header received
0806 20:32:12.554942 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.554946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.555072 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.555209 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:12.555536 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.556358 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.557779 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.558221 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.558344 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.558759 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:12.559291 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:12.559435 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.559554 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.559620 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:32:12.568066 26696 raft_consensus.cc:1261] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Refusing update from remote peer 3aa3930dab4243b89286ea9e7a52e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:12.568171 26471 raft_consensus.cc:1261] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Refusing update from remote peer 3aa3930dab4243b89286ea9e7a52e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:12.569165 26838 consensus_queue.cc:1035] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:12.569547 26826 consensus_queue.cc:1035] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:12.584227 26845 mvcc.cc:205] Tried to move back new op lower bound from 7315653970189742080 to 7315653970024886272. Current Snapshot: MvccSnapshot[applied={T|T < 7315653970189742080}]
I20260806 20:32:12.584704 26847 mvcc.cc:205] Tried to move back new op lower bound from 7315653970189742080 to 7315653970024886272. Current Snapshot: MvccSnapshot[applied={T|T < 7315653970189742080}]
I20260806 20:32:12.597534 25943 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:12.597829 25943 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:12.601769 25943 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Sending DeleteTablet for 3 replicas of tablet a59fc12bbcff4baa874d6f1c8fdb4cdf
I20260806 20:32:12.603120 26181 tablet_service.cc:1514] Processing DeleteTablet for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:12 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:59596
I20260806 20:32:12.603188 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:12 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:50266
I20260806 20:32:12.603950 26429 tablet_service.cc:1514] Processing DeleteTablet for tablet a59fc12bbcff4baa874d6f1c8fdb4cdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:12 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:36960
I20260806 20:32:12.604373 25943 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:32:12.605294 25943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:12.614313 26177 tablet_service.cc:1467] Processing CreateTablet for tablet 4b15a9cfe3c245c6923779c16253ad3d (DEFAULT_TABLE table=test-table [id=a5d2e2d3a40846b48ac398c6bc2e5524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:12.614455 26425 tablet_service.cc:1467] Processing CreateTablet for tablet 4b15a9cfe3c245c6923779c16253ad3d (DEFAULT_TABLE table=test-table [id=a5d2e2d3a40846b48ac398c6bc2e5524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:12.615175 26177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b15a9cfe3c245c6923779c16253ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.615234 26425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b15a9cfe3c245c6923779c16253ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.617895 26658 tablet_service.cc:1467] Processing CreateTablet for tablet 4b15a9cfe3c245c6923779c16253ad3d (DEFAULT_TABLE table=test-table [id=a5d2e2d3a40846b48ac398c6bc2e5524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:12.618575 26658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b15a9cfe3c245c6923779c16253ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.623338 26818 tablet_bootstrap.cc:492] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Bootstrap starting.
I20260806 20:32:12.625277 26818 tablet_bootstrap.cc:654] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.642062 26822 tablet_bootstrap.cc:492] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: Bootstrap starting.
I20260806 20:32:12.644025 26822 tablet_bootstrap.cc:654] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.646867 26817 tablet_bootstrap.cc:492] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: Bootstrap starting.
I20260806 20:32:12.649060 26817 tablet_bootstrap.cc:654] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.656008 26875 tablet_replica.cc:330] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: stopping tablet replica
I20260806 20:32:12.656592 26875 raft_consensus.cc:2229] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:12.657342 26875 raft_consensus.cc:2258] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:12.659889 26875 ts_tablet_manager.cc:1905] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:12.664808 26822 tablet_bootstrap.cc:492] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: No bootstrap required, opened a new log
I20260806 20:32:12.665442 26873 tablet_replica.cc:330] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: stopping tablet replica
I20260806 20:32:12.665927 26873 raft_consensus.cc:2229] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:12.666441 26873 raft_consensus.cc:2258] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:12.666496 26817 tablet_bootstrap.cc:492] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: No bootstrap required, opened a new log
I20260806 20:32:12.666685 26817 ts_tablet_manager.cc:1397] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.013s
I20260806 20:32:12.666678 26822 ts_tablet_manager.cc:1397] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.008s
I20260806 20:32:12.667346 26871 tablet_replica.cc:330] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: stopping tablet replica
I20260806 20:32:12.667662 26822 raft_consensus.cc:348] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.667778 26871 raft_consensus.cc:2229] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:32:12.667919 26822 raft_consensus.cc:374] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.667817 26817 raft_consensus.cc:348] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.668030 26817 raft_consensus.cc:374] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.668030 26822 raft_consensus.cc:729] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c29dd047b341fda188deb420720bf7, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.668143 26817 raft_consensus.cc:729] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9addfbcab2414f789cc86a242049dd49, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.668480 26871 raft_consensus.cc:2258] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:12.668403 26822 consensus_queue.cc:260] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.668496 26817 consensus_queue.cc:260] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.669104 26822 ts_tablet_manager.cc:1428] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260806 20:32:12.669801 26817 ts_tablet_manager.cc:1428] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 20:32:12.678547 26818 tablet_bootstrap.cc:492] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: No bootstrap required, opened a new log
I20260806 20:32:12.678737 26871 ts_tablet_manager.cc:1905] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:12.680182 26873 ts_tablet_manager.cc:1905] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:12.681329 26875 ts_tablet_manager.cc:1918] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:12.681581 26875 log.cc:1196] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/a59fc12bbcff4baa874d6f1c8fdb4cdf
I20260806 20:32:12.682282 26875 ts_tablet_manager.cc:1939] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 22c29dd047b341fda188deb420720bf7: Deleting consensus metadata
I20260806 20:32:12.683049 26818 ts_tablet_manager.cc:1397] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Time spent bootstrapping tablet: real 0.060s user 0.018s sys 0.017s
I20260806 20:32:12.684082 26818 raft_consensus.cc:348] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.684546 26818 raft_consensus.cc:374] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.684676 26818 raft_consensus.cc:729] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.684630 25922 catalog_manager.cc:4841] TS 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429): tablet a59fc12bbcff4baa874d6f1c8fdb4cdf (table test-table [id=819b78778d09473790a737bab036eb21]) successfully deleted
I20260806 20:32:12.685014 26818 consensus_queue.cc:260] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.685638 26818 ts_tablet_manager.cc:1428] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 20:32:12.686625 26871 ts_tablet_manager.cc:1918] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:12.686810 26871 log.cc:1196] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/a59fc12bbcff4baa874d6f1c8fdb4cdf
I20260806 20:32:12.687492 26871 ts_tablet_manager.cc:1939] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 3aa3930dab4243b89286ea9e7a52e643: Deleting consensus metadata
I20260806 20:32:12.689401 25922 catalog_manager.cc:4841] TS 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907): tablet a59fc12bbcff4baa874d6f1c8fdb4cdf (table test-table [id=819b78778d09473790a737bab036eb21]) successfully deleted
I20260806 20:32:12.690217 26873 ts_tablet_manager.cc:1918] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:12.690457 26873 log.cc:1196] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/a59fc12bbcff4baa874d6f1c8fdb4cdf
I20260806 20:32:12.690937 26873 ts_tablet_manager.cc:1939] T a59fc12bbcff4baa874d6f1c8fdb4cdf P 9addfbcab2414f789cc86a242049dd49: Deleting consensus metadata
I20260806 20:32:12.692551 25916 catalog_manager.cc:4841] TS 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891): tablet a59fc12bbcff4baa874d6f1c8fdb4cdf (table test-table [id=819b78778d09473790a737bab036eb21]) successfully deleted
I20260806 20:32:12.836020 26831 raft_consensus.cc:482] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:12.836303 26831 raft_consensus.cc:504] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.838413 26831 leader_election.cc:288] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:12.846585 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.839242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:37839 (local address 127.13.149.67:32891)
0806 20:32:12.839410 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.839416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.840032 (+ 616us) server_negotiation.cc:407] Connection header received
0806 20:32:12.840342 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.840349 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.840443 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.840541 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:12.841160 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.842075 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.844328 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.845459 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.845619 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.845693 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.846140 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.846284 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:32:12.846637 26883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.838690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:32891 (local address 127.13.149.66:37839)
0806 20:32:12.839916 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.839937 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.840159 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.840570 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.840575 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.840600 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:12.840962 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.840974 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.842208 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.842214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.844163 (+ 1949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.844177 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.845687 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.845694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.845877 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.845914 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.846095 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.846268 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1052,"thread_start_us":1315,"threads_started":1}
I20260806 20:32:12.846931 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.838886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:36155 (local address 127.13.149.65:34907)
0806 20:32:12.839077 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.839082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.840446 (+ 1364us) server_negotiation.cc:407] Connection header received
0806 20:32:12.840660 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.840666 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.840746 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.840863 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:12.841629 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.842751 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.844872 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.845753 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.845906 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.845978 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.846440 (+ 462us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.846596 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 20:32:12.847613 26882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.838798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:34907 (local address 127.13.149.66:36155)
0806 20:32:12.840327 (+ 1529us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.840346 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.840480 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.841018 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.841021 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.841039 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:12.841438 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.841451 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.842910 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.842916 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.844706 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.844717 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.846013 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.846019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.846232 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.846268 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.847177 (+ 909us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.847313 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1380,"thread_start_us":780,"threads_started":1}
I20260806 20:32:12.847568 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15a9cfe3c245c6923779c16253ad3d" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49" is_pre_election: true
I20260806 20:32:12.847836 26696 raft_consensus.cc:2454] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 0.
I20260806 20:32:12.848369 26332 leader_election.cc:302] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 9addfbcab2414f789cc86a242049dd49; no voters:
I20260806 20:32:12.848613 26222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15a9cfe3c245c6923779c16253ad3d" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aa3930dab4243b89286ea9e7a52e643" is_pre_election: true
I20260806 20:32:12.848831 26831 raft_consensus.cc:2781] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:12.848968 26831 raft_consensus.cc:482] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:12.849076 26831 raft_consensus.cc:3037] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:12.849119 26222 raft_consensus.cc:2454] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 0.
W20260806 20:32:12.851137 26300 tablet.cc:2369] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:32:12.852476 26831 raft_consensus.cc:504] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.853288 26831 leader_election.cc:288] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 election: Requested vote from peers 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:12.853889 26222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15a9cfe3c245c6923779c16253ad3d" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aa3930dab4243b89286ea9e7a52e643"
I20260806 20:32:12.854122 26222 raft_consensus.cc:3037] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:12.854043 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b15a9cfe3c245c6923779c16253ad3d" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49"
I20260806 20:32:12.854281 26696 raft_consensus.cc:3037] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:12.857384 26696 raft_consensus.cc:2454] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 1.
I20260806 20:32:12.857565 26222 raft_consensus.cc:2454] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 1.
I20260806 20:32:12.857882 26332 leader_election.cc:302] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 9addfbcab2414f789cc86a242049dd49; no voters:
I20260806 20:32:12.858374 26831 raft_consensus.cc:2781] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:12.858839 26831 raft_consensus.cc:686] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 1 LEADER]: Becoming Leader. State: Replica: 22c29dd047b341fda188deb420720bf7, State: Running, Role: LEADER
I20260806 20:32:12.859261 26831 consensus_queue.cc:237] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.862939 25943 catalog_manager.cc:5495] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c29dd047b341fda188deb420720bf7 (127.13.149.66). New cstate: current_term: 1 leader_uuid: "22c29dd047b341fda188deb420720bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } health_report { overall_health: UNKNOWN } } }
Aug 06 20:32:12 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048330, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.126@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:12.950596 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.931084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43372 (local address 127.13.149.126:44347)
0806 20:32:12.932076 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:12.932079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:12.932096 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:32:12.932130 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:12.932133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:12.932183 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:12.932292 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:12.933578 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.934306 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.935540 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.935939 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.936059 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.944989 (+ 8930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:12.944995 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:12.944999 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:12.945025 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:12.947564 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.948231 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.948239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.948243 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.948363 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:12.948723 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:12.948729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:12.948732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:12.949147 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:12.949284 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:12.949874 (+ 590us) server_negotiation.cc:299] Negotiation successful
0806 20:32:12.950255 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":151,"server-negotiator.queue_time_us":870,"thread_start_us":653,"threads_started":1}
I20260806 20:32:12.950626 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:12.931073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44347 (local address 127.0.0.1:43372)
0806 20:32:12.931757 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:12.931782 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:12.931936 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:12.932314 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:12.932318 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:12.933155 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:12.933391 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.933400 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.934452 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.934458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.935397 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:12.935408 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:12.936098 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:12.936104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:12.936293 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:12.942140 (+ 5847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:12.942163 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:12.944730 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:12.947692 (+ 2962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:12.947707 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:12.947715 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:12.948120 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:12.948462 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:12.948469 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:12.948472 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:12.948622 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:12.949311 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:12.949321 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:12.949530 (+ 209us) client_negotiation.cc:769] Sending connection context
0806 20:32:12.949754 (+ 224us) client_negotiation.cc:240] Negotiation successful
0806 20:32:12.950087 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":359,"threads_started":1}
I20260806 20:32:12.955873 25943 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:43372:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 20:32:12.957154 25943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:12.964192 26181 tablet_service.cc:1467] Processing CreateTablet for tablet 6254b70fa9cb46daac2cb1cc9096e983 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=15d5d394df9b4056b0d92b8deb6be9ba]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:32:12.964380 26429 tablet_service.cc:1467] Processing CreateTablet for tablet 6254b70fa9cb46daac2cb1cc9096e983 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=15d5d394df9b4056b0d92b8deb6be9ba]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:32:12.964897 26181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6254b70fa9cb46daac2cb1cc9096e983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.964939 26429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6254b70fa9cb46daac2cb1cc9096e983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.964706 26659 tablet_service.cc:1467] Processing CreateTablet for tablet 6254b70fa9cb46daac2cb1cc9096e983 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=15d5d394df9b4056b0d92b8deb6be9ba]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 20:32:12.965377 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6254b70fa9cb46daac2cb1cc9096e983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:12.972676 26817 tablet_bootstrap.cc:492] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: Bootstrap starting.
I20260806 20:32:12.972683 26822 tablet_bootstrap.cc:492] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: Bootstrap starting.
I20260806 20:32:12.973938 26822 tablet_bootstrap.cc:654] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.974472 26817 tablet_bootstrap.cc:654] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.976027 26818 tablet_bootstrap.cc:492] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: Bootstrap starting.
I20260806 20:32:12.976588 26817 tablet_bootstrap.cc:492] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: No bootstrap required, opened a new log
I20260806 20:32:12.976743 26817 ts_tablet_manager.cc:1397] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 20:32:12.977572 26818 tablet_bootstrap.cc:654] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:12.977548 26817 raft_consensus.cc:348] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.977794 26817 raft_consensus.cc:374] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.977890 26817 raft_consensus.cc:729] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9addfbcab2414f789cc86a242049dd49, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.978134 26817 consensus_queue.cc:260] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.978576 26825 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:12.978889 26825 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:32:12.979885 26817 ts_tablet_manager.cc:1428] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:12.982020 26818 tablet_bootstrap.cc:492] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: No bootstrap required, opened a new log
I20260806 20:32:12.982141 26822 tablet_bootstrap.cc:492] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: No bootstrap required, opened a new log
I20260806 20:32:12.982204 26818 ts_tablet_manager.cc:1397] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260806 20:32:12.982306 26822 ts_tablet_manager.cc:1397] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260806 20:32:12.982867 26822 raft_consensus.cc:348] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.983083 26822 raft_consensus.cc:374] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.983170 26822 raft_consensus.cc:729] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c29dd047b341fda188deb420720bf7, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.983032 26818 raft_consensus.cc:348] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.983286 26818 raft_consensus.cc:374] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:12.983376 26818 raft_consensus.cc:729] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Initialized, Role: FOLLOWER
I20260806 20:32:12.983415 26822 consensus_queue.cc:260] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.983616 26818 consensus_queue.cc:260] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:12.983999 26822 ts_tablet_manager.cc:1428] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 20:32:12.984611 26826 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:12.984954 26826 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:32:12.986315 26831 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:12.986610 26831 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:32:12.987164 26818 ts_tablet_manager.cc:1428] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260806 20:32:13.185235 26826 raft_consensus.cc:482] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:13.185426 26826 raft_consensus.cc:504] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.186148 26826 leader_election.cc:288] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:13.186707 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6254b70fa9cb46daac2cb1cc9096e983" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49" is_pre_election: true
I20260806 20:32:13.186690 26471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6254b70fa9cb46daac2cb1cc9096e983" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c29dd047b341fda188deb420720bf7" is_pre_election: true
I20260806 20:32:13.186949 26471 raft_consensus.cc:2454] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 0.
I20260806 20:32:13.186975 26696 raft_consensus.cc:2454] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 0.
I20260806 20:32:13.187399 26101 leader_election.cc:302] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 3aa3930dab4243b89286ea9e7a52e643; no voters:
I20260806 20:32:13.187669 26826 raft_consensus.cc:2781] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:13.187793 26826 raft_consensus.cc:482] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:13.187879 26826 raft_consensus.cc:3037] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:13.190843 26826 raft_consensus.cc:504] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.191423 26826 leader_election.cc:288] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 election: Requested vote from peers 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:13.191886 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6254b70fa9cb46daac2cb1cc9096e983" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49"
I20260806 20:32:13.191936 26471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6254b70fa9cb46daac2cb1cc9096e983" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c29dd047b341fda188deb420720bf7"
I20260806 20:32:13.192098 26696 raft_consensus.cc:3037] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:13.192147 26471 raft_consensus.cc:3037] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:13.194283 26471 raft_consensus.cc:2454] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 1.
I20260806 20:32:13.194727 26101 leader_election.cc:302] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 3aa3930dab4243b89286ea9e7a52e643; no voters:
I20260806 20:32:13.194984 26826 raft_consensus.cc:2781] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:13.195078 26696 raft_consensus.cc:2454] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 1.
I20260806 20:32:13.195415 26826 raft_consensus.cc:686] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 LEADER]: Becoming Leader. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Running, Role: LEADER
I20260806 20:32:13.195740 26826 consensus_queue.cc:237] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.197345 26907 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: TxnStatusTablet state changed. Reason: New leader 3aa3930dab4243b89286ea9e7a52e643. Latest consensus state: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:13.197644 26907 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:32:13.198213 26909 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 20:32:13.198457 26909 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 20:32:13.198936 25943 catalog_manager.cc:5495] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260806 20:32:13.226794 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.221631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.13.149.65:34907)
0806 20:32:13.221819 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:13.221825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:13.222040 (+ 215us) server_negotiation.cc:407] Connection header received
0806 20:32:13.222323 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:13.222327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:13.222401 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:13.222506 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:13.222859 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.223614 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.225008 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.225454 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.225580 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.226043 (+ 463us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:13.226149 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:13.226246 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:13.226410 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 20:32:13.226486 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 20:32:13.226828 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.221698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:34907 (local address 127.0.0.1:59614)
0806 20:32:13.221953 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:13.221969 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:13.222126 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:13.222533 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:13.222537 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:13.222549 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:32:13.222718 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:13.222727 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.223762 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.223768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:13.224872 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:13.224889 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.225611 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.225618 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:13.225806 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.225867 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:32:13.226251 (+ 384us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:32:13.226282 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 20:32:13.226382 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:32:13.226529 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 20:32:13.231720 26696 raft_consensus.cc:1261] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Refusing update from remote peer 3aa3930dab4243b89286ea9e7a52e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:13.231778 26471 raft_consensus.cc:1261] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Refusing update from remote peer 3aa3930dab4243b89286ea9e7a52e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:13.232342 26907 consensus_queue.cc:1035] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:13.232698 26826 consensus_queue.cc:1035] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:13.243213 26831 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: TxnStatusTablet state changed. Reason: New leader 3aa3930dab4243b89286ea9e7a52e643. Latest consensus state: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:13.243512 26831 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:32:13.245314 26913 mvcc.cc:205] Tried to move back new op lower bound from 7315653972908982272 to 7315653972772016128. Current Snapshot: MvccSnapshot[applied={T|T < 7315653972908982272}]
I20260806 20:32:13.247602 26826 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:13.247886 26826 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:32:13.254346 26831 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:13.254626 26831 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 22c29dd047b341fda188deb420720bf7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:32:13.255064 26825 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: TxnStatusTablet state changed. Reason: New leader 3aa3930dab4243b89286ea9e7a52e643. Latest consensus state: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:13.255316 26825 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:32:13.257633 26907 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:13.257978 26907 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 3aa3930dab4243b89286ea9e7a52e643: This TxnStatusTablet replica's current role is: LEADER
I20260806 20:32:13.260075 26825 tablet_replica.cc:439] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } } }
I20260806 20:32:13.260298 26825 tablet_replica.cc:442] T 6254b70fa9cb46daac2cb1cc9096e983 P 9addfbcab2414f789cc86a242049dd49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 20:32:13.273808 26929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.261399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36964 (local address 127.13.149.66:39429)
0806 20:32:13.267183 (+ 5784us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:13.267190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:13.267556 (+ 366us) server_negotiation.cc:407] Connection header received
0806 20:32:13.267751 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:13.267756 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:13.267919 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:13.268108 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:13.268509 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.269717 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.271034 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.271725 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.271855 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.272287 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:13.273118 (+ 831us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:13.273267 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:13.273345 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 20:32:13.273430 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5654,"thread_start_us":5541,"threads_started":1}
I20260806 20:32:13.289593 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.283476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:47473 (local address 127.13.149.65:34907)
0806 20:32:13.283726 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:13.283735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:13.284258 (+ 523us) server_negotiation.cc:407] Connection header received
0806 20:32:13.284425 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:13.284429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:13.284499 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:13.284572 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:13.285144 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.285966 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.287939 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.288371 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.288462 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.288985 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:13.289102 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:13.289169 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:13.289307 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 20:32:13.289363 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 20:32:13.289829 26933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.283477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:34907 (local address 127.13.149.66:47473)
0806 20:32:13.284161 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:13.284180 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:13.284313 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:13.284621 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:13.284626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:13.284638 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:32:13.284988 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:13.284999 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.286104 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.286109 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:13.287808 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:13.287823 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.288545 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.288552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:13.288736 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.288828 (+ 92us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:32:13.289197 (+ 369us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:32:13.289209 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 20:32:13.289298 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 20:32:13.289435 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":377,"threads_started":1}
I20260806 20:32:13.299209 26696 raft_consensus.cc:1261] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Refusing update from remote peer 22c29dd047b341fda188deb420720bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:13.299400 26222 raft_consensus.cc:1261] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Refusing update from remote peer 22c29dd047b341fda188deb420720bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:13.299913 26885 consensus_queue.cc:1035] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:13.300336 26831 consensus_queue.cc:1035] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:13.339349 26929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.329457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:55949 (local address 127.13.149.66:39429)
0806 20:32:13.329603 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:13.329610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:13.333889 (+ 4279us) server_negotiation.cc:407] Connection header received
0806 20:32:13.334095 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:13.334098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:13.334157 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:13.334229 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:13.334817 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.335624 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.337693 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.338103 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.338228 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.338664 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:13.338765 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:13.338856 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:13.338970 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 20:32:13.339056 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 20:32:13.339535 26939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.329077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:39429 (local address 127.13.149.65:55949)
0806 20:32:13.333790 (+ 4713us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:13.333816 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:13.333967 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:13.334273 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:13.334278 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:13.334291 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 20:32:13.334677 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:13.334689 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.335744 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.335750 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:13.337534 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:13.337547 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.338301 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.338309 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:13.338439 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.338489 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 20:32:13.338861 (+ 372us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 20:32:13.338875 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 20:32:13.338953 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 20:32:13.339091 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4525,"thread_start_us":4060,"threads_started":1}
I20260806 20:32:13.387697 25943 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:13.387967 25943 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:13.391440 25943 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Sending DeleteTablet for 3 replicas of tablet 4b15a9cfe3c245c6923779c16253ad3d
I20260806 20:32:13.392364 26429 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15a9cfe3c245c6923779c16253ad3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:13 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:36960
I20260806 20:32:13.392382 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15a9cfe3c245c6923779c16253ad3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:13 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:50266
I20260806 20:32:13.396760 26181 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b15a9cfe3c245c6923779c16253ad3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:13 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:59596
I20260806 20:32:13.407891 26952 tablet_replica.cc:330] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: stopping tablet replica
I20260806 20:32:13.408108 26952 raft_consensus.cc:2229] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:13.408365 26952 raft_consensus.cc:2258] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:13.409495 26952 ts_tablet_manager.cc:1905] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:13.420624 26950 tablet_replica.cc:330] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: stopping tablet replica
I20260806 20:32:13.421155 26950 raft_consensus.cc:2229] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:32:13.421942 26950 raft_consensus.cc:2258] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:13.423219 26950 ts_tablet_manager.cc:1905] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:13.423908 26953 tablet_replica.cc:330] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: stopping tablet replica
I20260806 20:32:13.431048 26953 raft_consensus.cc:2229] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:13.431494 26953 raft_consensus.cc:2258] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:13.432952 26953 ts_tablet_manager.cc:1905] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:13.434508 26952 ts_tablet_manager.cc:1918] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:32:13.434659 26952 log.cc:1196] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/4b15a9cfe3c245c6923779c16253ad3d
I20260806 20:32:13.435122 26952 ts_tablet_manager.cc:1939] T 4b15a9cfe3c245c6923779c16253ad3d P 9addfbcab2414f789cc86a242049dd49: Deleting consensus metadata
I20260806 20:32:13.436297 25916 catalog_manager.cc:4841] TS 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891): tablet 4b15a9cfe3c245c6923779c16253ad3d (table test-table [id=a5d2e2d3a40846b48ac398c6bc2e5524]) successfully deleted
I20260806 20:32:13.437424 26950 ts_tablet_manager.cc:1918] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:32:13.437626 26950 log.cc:1196] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/4b15a9cfe3c245c6923779c16253ad3d
I20260806 20:32:13.438174 26950 ts_tablet_manager.cc:1939] T 4b15a9cfe3c245c6923779c16253ad3d P 22c29dd047b341fda188deb420720bf7: Deleting consensus metadata
I20260806 20:32:13.439334 25922 catalog_manager.cc:4841] TS 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429): tablet 4b15a9cfe3c245c6923779c16253ad3d (table test-table [id=a5d2e2d3a40846b48ac398c6bc2e5524]) successfully deleted
I20260806 20:32:13.440959 26953 ts_tablet_manager.cc:1918] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:32:13.441226 26953 log.cc:1196] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/4b15a9cfe3c245c6923779c16253ad3d
I20260806 20:32:13.441793 26953 ts_tablet_manager.cc:1939] T 4b15a9cfe3c245c6923779c16253ad3d P 3aa3930dab4243b89286ea9e7a52e643: Deleting consensus metadata
I20260806 20:32:13.442939 25922 catalog_manager.cc:4841] TS 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907): tablet 4b15a9cfe3c245c6923779c16253ad3d (table test-table [id=a5d2e2d3a40846b48ac398c6bc2e5524]) successfully deleted
Aug 06 20:32:13 dist-test-slave-2kcd krb5kdc[25858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 20:32:13 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:13 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 20:32:13.521003 26964 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:13.494864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43378 (local address 127.13.149.126:44347)
0806 20:32:13.507268 (+ 12404us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:13.507276 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:13.507989 (+ 713us) server_negotiation.cc:407] Connection header received
0806 20:32:13.508198 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:13.508205 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:13.508298 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:13.508437 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:13.510314 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.511572 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.513542 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.514243 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.514380 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.520652 (+ 6272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43378: BlockingRecv error: recv got EOF from 127.0.0.1:43378 (error 108)
Metrics: {"server-negotiator.queue_time_us":12229,"thread_start_us":12418,"threads_started":1}
Aug 06 20:32:13 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM
I20260806 20:32:13.548766 26964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:13.530368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43384 (local address 127.13.149.126:44347)
0806 20:32:13.530553 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:13.530559 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:13.531047 (+ 488us) server_negotiation.cc:407] Connection header received
0806 20:32:13.531229 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:13.531235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:13.531322 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:13.531430 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:13.533008 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.534178 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.535989 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:13.536646 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:13.536777 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:13.541822 (+ 5045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:13.541829 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:13.541834 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:13.541876 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:13.545700 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:13.546512 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:13.546518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:13.546522 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:13.546675 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:13.547115 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:13.547120 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:13.547124 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:13.547493 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:13.547777 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:13.548094 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 20:32:13.548350 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 20:32:13.553170 25943 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:32:13.553920 25943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:13.562244 26181 tablet_service.cc:1467] Processing CreateTablet for tablet ed87896da14945cfb75a2f5177d63f88 (DEFAULT_TABLE table=test-table [id=7ae026f590a1453597659c6af4b995bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:13.562373 26659 tablet_service.cc:1467] Processing CreateTablet for tablet ed87896da14945cfb75a2f5177d63f88 (DEFAULT_TABLE table=test-table [id=7ae026f590a1453597659c6af4b995bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:13.562750 26181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed87896da14945cfb75a2f5177d63f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:13.562837 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed87896da14945cfb75a2f5177d63f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:13.569419 26429 tablet_service.cc:1467] Processing CreateTablet for tablet ed87896da14945cfb75a2f5177d63f88 (DEFAULT_TABLE table=test-table [id=7ae026f590a1453597659c6af4b995bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:13.569854 26429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed87896da14945cfb75a2f5177d63f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:13.575579 26979 tablet_bootstrap.cc:492] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: Bootstrap starting.
I20260806 20:32:13.577457 26979 tablet_bootstrap.cc:654] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:13.578979 26981 tablet_bootstrap.cc:492] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: Bootstrap starting.
I20260806 20:32:13.581144 26981 tablet_bootstrap.cc:654] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:13.581611 26982 tablet_bootstrap.cc:492] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: Bootstrap starting.
I20260806 20:32:13.584894 26982 tablet_bootstrap.cc:654] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:13.586948 26981 tablet_bootstrap.cc:492] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: No bootstrap required, opened a new log
I20260806 20:32:13.587694 26981 ts_tablet_manager.cc:1397] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20260806 20:32:13.588934 26981 raft_consensus.cc:348] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.590812 26979 tablet_bootstrap.cc:492] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: No bootstrap required, opened a new log
I20260806 20:32:13.591005 26979 ts_tablet_manager.cc:1397] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260806 20:32:13.591809 26979 raft_consensus.cc:348] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.592126 26979 raft_consensus.cc:374] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:13.592270 26979 raft_consensus.cc:729] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9addfbcab2414f789cc86a242049dd49, State: Initialized, Role: FOLLOWER
I20260806 20:32:13.592608 26979 consensus_queue.cc:260] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.595674 26979 ts_tablet_manager.cc:1428] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260806 20:32:13.597949 26981 raft_consensus.cc:374] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:13.598126 26981 raft_consensus.cc:729] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Initialized, Role: FOLLOWER
I20260806 20:32:13.598475 26981 consensus_queue.cc:260] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.599165 26981 ts_tablet_manager.cc:1428] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260806 20:32:13.602279 26982 tablet_bootstrap.cc:492] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: No bootstrap required, opened a new log
I20260806 20:32:13.602535 26982 ts_tablet_manager.cc:1397] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.004s
I20260806 20:32:13.603502 26982 raft_consensus.cc:348] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.603789 26982 raft_consensus.cc:374] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:13.603901 26982 raft_consensus.cc:729] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c29dd047b341fda188deb420720bf7, State: Initialized, Role: FOLLOWER
I20260806 20:32:13.604184 26982 consensus_queue.cc:260] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.604833 26982 ts_tablet_manager.cc:1428] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 20:32:13.919355 26907 raft_consensus.cc:482] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:13.919631 26907 raft_consensus.cc:504] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.920374 26907 leader_election.cc:288] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:13.921084 26471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed87896da14945cfb75a2f5177d63f88" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c29dd047b341fda188deb420720bf7" is_pre_election: true
I20260806 20:32:13.921180 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed87896da14945cfb75a2f5177d63f88" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49" is_pre_election: true
I20260806 20:32:13.921406 26471 raft_consensus.cc:2454] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 0.
I20260806 20:32:13.921428 26696 raft_consensus.cc:2454] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 0.
I20260806 20:32:13.921921 26101 leader_election.cc:302] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 3aa3930dab4243b89286ea9e7a52e643; no voters:
I20260806 20:32:13.922214 26907 raft_consensus.cc:2781] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:13.922302 26907 raft_consensus.cc:482] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:13.922428 26907 raft_consensus.cc:3037] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:13.924523 26907 raft_consensus.cc:504] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.925139 26907 leader_election.cc:288] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 election: Requested vote from peers 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:13.925626 26471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed87896da14945cfb75a2f5177d63f88" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c29dd047b341fda188deb420720bf7"
I20260806 20:32:13.925843 26471 raft_consensus.cc:3037] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:13.925724 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed87896da14945cfb75a2f5177d63f88" candidate_uuid: "3aa3930dab4243b89286ea9e7a52e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49"
I20260806 20:32:13.926038 26696 raft_consensus.cc:3037] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:13.927940 26471 raft_consensus.cc:2454] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 1.
I20260806 20:32:13.928007 26696 raft_consensus.cc:2454] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3aa3930dab4243b89286ea9e7a52e643 in term 1.
I20260806 20:32:13.928444 26101 leader_election.cc:302] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 3aa3930dab4243b89286ea9e7a52e643, 9addfbcab2414f789cc86a242049dd49; no voters:
I20260806 20:32:13.928753 26907 raft_consensus.cc:2781] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:13.929265 26907 raft_consensus.cc:686] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 LEADER]: Becoming Leader. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Running, Role: LEADER
I20260806 20:32:13.929543 26907 consensus_queue.cc:237] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:13.931883 25942 catalog_manager.cc:5495] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "3aa3930dab4243b89286ea9e7a52e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260806 20:32:14.033428 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:14.028414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.13.149.65:34907)
0806 20:32:14.028962 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:14.028969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:14.028989 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:32:14.029063 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:14.029066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:14.029131 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:14.029239 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:14.029619 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.030322 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.031693 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.032119 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.032250 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:14.032655 (+ 405us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:14.032764 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:14.032876 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:14.033039 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 20:32:14.033136 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":273,"threads_started":1}
I20260806 20:32:14.036505 26696 raft_consensus.cc:1261] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Refusing update from remote peer 3aa3930dab4243b89286ea9e7a52e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:14.036625 26471 raft_consensus.cc:1261] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Refusing update from remote peer 3aa3930dab4243b89286ea9e7a52e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:14.037220 26995 consensus_queue.cc:1035] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:14.037593 26907 consensus_queue.cc:1035] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:14.053231 25942 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:14.053463 25942 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:14.056646 25942 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Sending DeleteTablet for 3 replicas of tablet ed87896da14945cfb75a2f5177d63f88
I20260806 20:32:14.057638 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet ed87896da14945cfb75a2f5177d63f88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:14 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:50266
I20260806 20:32:14.057849 26429 tablet_service.cc:1514] Processing DeleteTablet for tablet ed87896da14945cfb75a2f5177d63f88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:14 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:36960
I20260806 20:32:14.058092 26181 tablet_service.cc:1514] Processing DeleteTablet for tablet ed87896da14945cfb75a2f5177d63f88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:14 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:59596
I20260806 20:32:14.058532 27014 tablet_replica.cc:330] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: stopping tablet replica
I20260806 20:32:14.058740 27014 raft_consensus.cc:2229] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:14.058691 25942 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 20:32:14.059022 27014 raft_consensus.cc:2258] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 20:32:14.059514 25942 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:14.060024 27014 ts_tablet_manager.cc:1905] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:14.061127 27011 tablet_replica.cc:330] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: stopping tablet replica
I20260806 20:32:14.061393 27011 raft_consensus.cc:2229] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:14.061697 27011 raft_consensus.cc:2258] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:14.062275 27016 tablet_replica.cc:330] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: stopping tablet replica
I20260806 20:32:14.062480 27016 raft_consensus.cc:2229] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:32:14.062878 27016 raft_consensus.cc:2258] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:14.062915 27011 ts_tablet_manager.cc:1905] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:14.065033 27016 ts_tablet_manager.cc:1905] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:14.067823 26429 tablet_service.cc:1467] Processing CreateTablet for tablet d814d6c1fa7b417385aa9cd9b42efc48 (DEFAULT_TABLE table=test-table [id=1e0584d405d94e0dafedf881c3121182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:14.068361 26429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d814d6c1fa7b417385aa9cd9b42efc48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:14.068383 27014 ts_tablet_manager.cc:1918] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:14.068607 27014 log.cc:1196] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/ed87896da14945cfb75a2f5177d63f88
I20260806 20:32:14.069120 27014 ts_tablet_manager.cc:1939] T ed87896da14945cfb75a2f5177d63f88 P 22c29dd047b341fda188deb420720bf7: Deleting consensus metadata
I20260806 20:32:14.069999 27011 ts_tablet_manager.cc:1918] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:14.070132 27011 log.cc:1196] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/ed87896da14945cfb75a2f5177d63f88
I20260806 20:32:14.070519 27011 ts_tablet_manager.cc:1939] T ed87896da14945cfb75a2f5177d63f88 P 9addfbcab2414f789cc86a242049dd49: Deleting consensus metadata
I20260806 20:32:14.071424 25916 catalog_manager.cc:4841] TS 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891): tablet ed87896da14945cfb75a2f5177d63f88 (table test-table [id=7ae026f590a1453597659c6af4b995bb]) successfully deleted
I20260806 20:32:14.071919 25922 catalog_manager.cc:4841] TS 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429): tablet ed87896da14945cfb75a2f5177d63f88 (table test-table [id=7ae026f590a1453597659c6af4b995bb]) successfully deleted
I20260806 20:32:14.072182 26659 tablet_service.cc:1467] Processing CreateTablet for tablet d814d6c1fa7b417385aa9cd9b42efc48 (DEFAULT_TABLE table=test-table [id=1e0584d405d94e0dafedf881c3121182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:14.072578 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d814d6c1fa7b417385aa9cd9b42efc48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:14.073117 26181 tablet_service.cc:1467] Processing CreateTablet for tablet d814d6c1fa7b417385aa9cd9b42efc48 (DEFAULT_TABLE table=test-table [id=1e0584d405d94e0dafedf881c3121182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:14.073479 26181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d814d6c1fa7b417385aa9cd9b42efc48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:14.074360 27016 ts_tablet_manager.cc:1918] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:14.074529 27016 log.cc:1196] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/ed87896da14945cfb75a2f5177d63f88
I20260806 20:32:14.075073 27016 ts_tablet_manager.cc:1939] T ed87896da14945cfb75a2f5177d63f88 P 3aa3930dab4243b89286ea9e7a52e643: Deleting consensus metadata
I20260806 20:32:14.076552 25922 catalog_manager.cc:4841] TS 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907): tablet ed87896da14945cfb75a2f5177d63f88 (table test-table [id=7ae026f590a1453597659c6af4b995bb]) successfully deleted
I20260806 20:32:14.078004 26982 tablet_bootstrap.cc:492] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: Bootstrap starting.
I20260806 20:32:14.079059 26979 tablet_bootstrap.cc:492] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: Bootstrap starting.
I20260806 20:32:14.079523 26982 tablet_bootstrap.cc:654] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:14.080681 26979 tablet_bootstrap.cc:654] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:14.080668 26981 tablet_bootstrap.cc:492] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: Bootstrap starting.
I20260806 20:32:14.082326 26981 tablet_bootstrap.cc:654] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:14.083041 26979 tablet_bootstrap.cc:492] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: No bootstrap required, opened a new log
I20260806 20:32:14.083243 26979 ts_tablet_manager.cc:1397] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260806 20:32:14.083870 26979 raft_consensus.cc:348] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.084076 26979 raft_consensus.cc:374] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:14.084182 26979 raft_consensus.cc:729] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9addfbcab2414f789cc86a242049dd49, State: Initialized, Role: FOLLOWER
I20260806 20:32:14.084355 26981 tablet_bootstrap.cc:492] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: No bootstrap required, opened a new log
I20260806 20:32:14.084427 26979 consensus_queue.cc:260] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.084559 26981 ts_tablet_manager.cc:1397] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 20:32:14.085182 26979 ts_tablet_manager.cc:1428] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 20:32:14.085197 26981 raft_consensus.cc:348] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.085450 26981 raft_consensus.cc:374] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:14.085537 26981 raft_consensus.cc:729] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa3930dab4243b89286ea9e7a52e643, State: Initialized, Role: FOLLOWER
I20260806 20:32:14.085837 26981 consensus_queue.cc:260] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.086849 26981 ts_tablet_manager.cc:1428] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 20:32:14.087637 26982 tablet_bootstrap.cc:492] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: No bootstrap required, opened a new log
I20260806 20:32:14.087815 26982 ts_tablet_manager.cc:1397] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.004s
I20260806 20:32:14.088511 26982 raft_consensus.cc:348] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.088759 26982 raft_consensus.cc:374] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:14.088929 26982 raft_consensus.cc:729] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c29dd047b341fda188deb420720bf7, State: Initialized, Role: FOLLOWER
I20260806 20:32:14.089198 26982 consensus_queue.cc:260] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.089761 26982 ts_tablet_manager.cc:1428] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 20:32:14.099525 26937 raft_consensus.cc:482] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:14.099707 26937 raft_consensus.cc:504] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.100459 26937 leader_election.cc:288] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:14.100917 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d814d6c1fa7b417385aa9cd9b42efc48" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49" is_pre_election: true
I20260806 20:32:14.100965 26222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d814d6c1fa7b417385aa9cd9b42efc48" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aa3930dab4243b89286ea9e7a52e643" is_pre_election: true
I20260806 20:32:14.101130 26696 raft_consensus.cc:2454] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 0.
I20260806 20:32:14.101203 26222 raft_consensus.cc:2454] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 0.
I20260806 20:32:14.101585 26332 leader_election.cc:302] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 9addfbcab2414f789cc86a242049dd49; no voters:
I20260806 20:32:14.101971 26937 raft_consensus.cc:2781] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:14.102105 26937 raft_consensus.cc:482] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:14.102200 26937 raft_consensus.cc:3037] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:14.105288 26937 raft_consensus.cc:504] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.105932 26937 leader_election.cc:288] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 election: Requested vote from peers 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907), 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891)
I20260806 20:32:14.106348 26696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d814d6c1fa7b417385aa9cd9b42efc48" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9addfbcab2414f789cc86a242049dd49"
I20260806 20:32:14.106389 26222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d814d6c1fa7b417385aa9cd9b42efc48" candidate_uuid: "22c29dd047b341fda188deb420720bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aa3930dab4243b89286ea9e7a52e643"
I20260806 20:32:14.106524 26696 raft_consensus.cc:3037] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:14.106596 26222 raft_consensus.cc:3037] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:14.109010 26696 raft_consensus.cc:2454] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 1.
I20260806 20:32:14.109408 26332 leader_election.cc:302] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c29dd047b341fda188deb420720bf7, 9addfbcab2414f789cc86a242049dd49; no voters:
I20260806 20:32:14.109681 26937 raft_consensus.cc:2781] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:14.109753 26222 raft_consensus.cc:2454] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c29dd047b341fda188deb420720bf7 in term 1.
I20260806 20:32:14.110184 26937 raft_consensus.cc:686] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 1 LEADER]: Becoming Leader. State: Replica: 22c29dd047b341fda188deb420720bf7, State: Running, Role: LEADER
I20260806 20:32:14.110495 26937 consensus_queue.cc:237] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } }
I20260806 20:32:14.113026 25943 catalog_manager.cc:5495] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c29dd047b341fda188deb420720bf7 (127.13.149.66). New cstate: current_term: 1 leader_uuid: "22c29dd047b341fda188deb420720bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c29dd047b341fda188deb420720bf7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260806 20:32:14.135118 27028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:14.130008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36974 (local address 127.13.149.66:39429)
0806 20:32:14.130556 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:14.130560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:14.130578 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:32:14.130625 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:14.130628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:14.130687 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:14.130796 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:14.131196 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.131958 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.133357 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.133785 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.133938 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:14.134380 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:14.134491 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:14.134590 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:14.134740 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 20:32:14.134815 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":329,"threads_started":1}
I20260806 20:32:14.143532 26696 raft_consensus.cc:1261] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Refusing update from remote peer 22c29dd047b341fda188deb420720bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:14.143702 26222 raft_consensus.cc:1261] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Refusing update from remote peer 22c29dd047b341fda188deb420720bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:14.144098 27024 consensus_queue.cc:1035] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9addfbcab2414f789cc86a242049dd49" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:14.144488 26937 consensus_queue.cc:1035] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3aa3930dab4243b89286ea9e7a52e643" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:14.190999 25943 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:14.191237 25943 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:14.194027 25943 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee35f9a0cdac4d41831f05d5efc872f7: Sending DeleteTablet for 3 replicas of tablet d814d6c1fa7b417385aa9cd9b42efc48
I20260806 20:32:14.194901 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet d814d6c1fa7b417385aa9cd9b42efc48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:14 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:50266
I20260806 20:32:14.195019 26429 tablet_service.cc:1514] Processing DeleteTablet for tablet d814d6c1fa7b417385aa9cd9b42efc48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:14 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:36960
I20260806 20:32:14.195202 27011 tablet_replica.cc:330] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: stopping tablet replica
I20260806 20:32:14.195197 26181 tablet_service.cc:1514] Processing DeleteTablet for tablet d814d6c1fa7b417385aa9cd9b42efc48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:14 UTC) from {username='oryx', principal='oryx/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:59596
I20260806 20:32:14.195411 27011 raft_consensus.cc:2229] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:14.195577 27016 tablet_replica.cc:330] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: stopping tablet replica
I20260806 20:32:14.195588 27014 tablet_replica.cc:330] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: stopping tablet replica
I20260806 20:32:14.195619 27011 raft_consensus.cc:2258] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:14.195780 27016 raft_consensus.cc:2229] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:14.195873 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 26073
I20260806 20:32:14.195983 27016 raft_consensus.cc:2258] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:14.196687 27014 raft_consensus.cc:2229] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:32:14.197032 27011 ts_tablet_manager.cc:1905] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:14.197052 27014 raft_consensus.cc:2258] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:14.198101 27014 ts_tablet_manager.cc:1905] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:14.199854 27016 ts_tablet_manager.cc:1905] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:14.203970 27011 ts_tablet_manager.cc:1918] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:32:14.204105 27011 log.cc:1196] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/d814d6c1fa7b417385aa9cd9b42efc48
I20260806 20:32:14.204540 27011 ts_tablet_manager.cc:1939] T d814d6c1fa7b417385aa9cd9b42efc48 P 9addfbcab2414f789cc86a242049dd49: Deleting consensus metadata
I20260806 20:32:14.204536 27014 ts_tablet_manager.cc:1918] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:32:14.204674 27014 log.cc:1196] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/d814d6c1fa7b417385aa9cd9b42efc48
I20260806 20:32:14.205101 27014 ts_tablet_manager.cc:1939] T d814d6c1fa7b417385aa9cd9b42efc48 P 22c29dd047b341fda188deb420720bf7: Deleting consensus metadata
I20260806 20:32:14.206043 25916 catalog_manager.cc:4841] TS 9addfbcab2414f789cc86a242049dd49 (127.13.149.67:32891): tablet d814d6c1fa7b417385aa9cd9b42efc48 (table test-table [id=1e0584d405d94e0dafedf881c3121182]) successfully deleted
I20260806 20:32:14.206527 25922 catalog_manager.cc:4841] TS 22c29dd047b341fda188deb420720bf7 (127.13.149.66:39429): tablet d814d6c1fa7b417385aa9cd9b42efc48 (table test-table [id=1e0584d405d94e0dafedf881c3121182]) successfully deleted
I20260806 20:32:14.207194 27016 ts_tablet_manager.cc:1918] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 20:32:14.207365 27016 log.cc:1196] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/d814d6c1fa7b417385aa9cd9b42efc48
I20260806 20:32:14.207826 27016 ts_tablet_manager.cc:1939] T d814d6c1fa7b417385aa9cd9b42efc48 P 3aa3930dab4243b89286ea9e7a52e643: Deleting consensus metadata
I20260806 20:32:14.208842 25922 catalog_manager.cc:4841] TS 3aa3930dab4243b89286ea9e7a52e643 (127.13.149.65:34907): tablet d814d6c1fa7b417385aa9cd9b42efc48 (table test-table [id=1e0584d405d94e0dafedf881c3121182]) successfully deleted
Aug 06 20:32:14 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.65@KRBTEST.COM
I20260806 20:32:14.220310 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:14.198032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59630 (local address 127.13.149.65:34907)
0806 20:32:14.198174 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:14.198180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:14.204159 (+ 5979us) server_negotiation.cc:407] Connection header received
0806 20:32:14.204446 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:14.204452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:14.204534 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:14.204608 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:14.206483 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.207754 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.209451 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.209859 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.210004 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:14.214442 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:14.214458 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:14.214475 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:14.214511 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:14.217597 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:14.218338 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:14.218345 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:14.218347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:14.218491 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:14.218839 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:14.218843 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:14.218845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:14.219191 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:14.219399 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:14.219773 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 20:32:14.219936 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 20:32:14.221058 26289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:14.373845 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 26073
I20260806 20:32:14.411798 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 26304
Aug 06 20:32:14 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.66@KRBTEST.COM
I20260806 20:32:14.430259 27028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:14.412560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36986 (local address 127.13.149.66:39429)
0806 20:32:14.412749 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:14.412758 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:14.412897 (+ 139us) server_negotiation.cc:407] Connection header received
0806 20:32:14.414381 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:14.414391 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:14.414498 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:14.414620 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:14.416172 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.417296 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.418646 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.419297 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.419427 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:14.423724 (+ 4297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:14.423741 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:14.423762 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:14.423802 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:14.427581 (+ 3779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:14.428243 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:14.428252 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:14.428256 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:14.428395 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:14.428746 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:14.428751 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:14.428755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:14.429185 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:14.429497 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:14.429668 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 20:32:14.429920 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:32:14.430994 26536 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:14.561631 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 26304
I20260806 20:32:14.593011 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 26548
Aug 06 20:32:14 dist-test-slave-2kcd krb5kdc[25858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.149.67@KRBTEST.COM
I20260806 20:32:14.608865 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:14.593823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50282 (local address 127.13.149.67:32891)
0806 20:32:14.594334 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:14.594338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:14.594354 (+ 16us) server_negotiation.cc:407] Connection header received
0806 20:32:14.594410 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:14.594415 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:14.594479 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:14.594601 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:14.595953 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.596717 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.598087 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:14.598467 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:14.598561 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:14.602973 (+ 4412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:14.602987 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:14.603004 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:14.603041 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:14.606069 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:14.606730 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:14.606738 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:14.606741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:14.606948 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:14.607308 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:14.607313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:14.607317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:14.607692 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:14.607955 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:14.608180 (+ 225us) server_negotiation.cc:299] Negotiation successful
0806 20:32:14.608398 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":238,"threads_started":1}
I20260806 20:32:14.609609 26766 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:14.706961 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 26548
I20260806 20:32:14.733160 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 25888
I20260806 20:32:14.734411 26014 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:14.850963 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 25888
2026-08-06T20:32:14Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6444 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:32:14 dist-test-slave-2kcd krb5kdc[27050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:32:14 dist-test-slave-2kcd krb5kdc[27050](info): set up 2 sockets
Aug 06 20:32:14 dist-test-slave-2kcd krb5kdc[27050](info): commencing operation
krb5kdc: starting...
W20260806 20:32:16.180183 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:32:16 dist-test-slave-2kcd krb5kdc[27050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:32:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:32:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:32:16.448621 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38231
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:44905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:38231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:16.785619 27073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:16.785920 27073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:16.786127 27073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:16.793497 27073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:16.793614 27073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:16.793725 27073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:16.793879 27073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:16.793944 27073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:16.803979 27073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:44905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:38231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:16.805418 27073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:16.806782 27073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:16.819139 27078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:16.819047 27080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:16.819095 27082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:16.819957 27073 server_base.cc:1034] running on GCE node
I20260806 20:32:16.820997 27073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:16.822413 27073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:16.823657 27073 hybrid_clock.cc:648] HybridClock initialized: now 1786048336823593 us; error 45 us; skew 500 ppm
I20260806 20:32:16.824014 27073 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T20:32:16Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2033 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:32:16 dist-test-slave-2kcd krb5kdc[27094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:32:16 dist-test-slave-2kcd krb5kdc[27094](info): set up 2 sockets
Aug 06 20:32:16 dist-test-slave-2kcd krb5kdc[27094](info): commencing operation
krb5kdc: starting...
W20260806 20:32:18.209652 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.005s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:32:18 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:32:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:32:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:32:18.476399 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:34885
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:34885
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:18.808822 27117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:18.809176 27117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:18.809330 27117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:18.816537 27117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:18.816701 27117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:18.816829 27117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:18.816954 27117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:18.817031 27117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:18.826891 27117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:34885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:34885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:18.828245 27117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:18.829725 27117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:18.841740 27126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:18.841873 27123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:18.841972 27122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:18.842947 27117 server_base.cc:1034] running on GCE node
I20260806 20:32:18.843832 27117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:18.845399 27117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:18.846680 27117 hybrid_clock.cc:648] HybridClock initialized: now 1786048338846607 us; error 55 us; skew 500 ppm
I20260806 20:32:18.847071 27117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:18 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048338, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:18.855581 27117 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:32:18.857255 27117 webserver.cc:460] Webserver started at http://127.13.149.126:45641/ using document root <none> and password file <none>
I20260806 20:32:18.857968 27117 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:18.858116 27117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:18.858448 27117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:18.861593 27117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "6a7390282a2545ad86e75ad7affe219e"
format_stamp: "Formatted at 2026-08-06 20:32:18 on dist-test-slave-2kcd"
server_key: "739e0d1e4981c876c15cf8821c6e5e4c"
server_key_iv: "8720d6b3a5ddb27192b15c4b356ad8ed"
server_key_version: "encryptionkey@0"
I20260806 20:32:18.862360 27117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "6a7390282a2545ad86e75ad7affe219e"
format_stamp: "Formatted at 2026-08-06 20:32:18 on dist-test-slave-2kcd"
server_key: "739e0d1e4981c876c15cf8821c6e5e4c"
server_key_iv: "8720d6b3a5ddb27192b15c4b356ad8ed"
server_key_version: "encryptionkey@0"
I20260806 20:32:18.867475 27117 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:32:18.871270 27135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:18.872558 27117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 20:32:18.872752 27117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "6a7390282a2545ad86e75ad7affe219e"
format_stamp: "Formatted at 2026-08-06 20:32:18 on dist-test-slave-2kcd"
server_key: "739e0d1e4981c876c15cf8821c6e5e4c"
server_key_iv: "8720d6b3a5ddb27192b15c4b356ad8ed"
server_key_version: "encryptionkey@0"
I20260806 20:32:18.872993 27117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:18.901381 27117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:18.905416 27117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:18.905727 27117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:18.924144 27117 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:34885
I20260806 20:32:18.924152 27219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:34885 every 8 connection(s)
I20260806 20:32:18.925604 27117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:32:18.929387 27221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:18.931241 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 27117
I20260806 20:32:18.931475 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:32:18.932300 13909 external_mini_cluster.cc:1428] Setting key 59b4273463abe25ceb76d2a836447466
I20260806 20:32:18.944178 27221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Bootstrap starting.
Aug 06 20:32:18 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:18.947443 27221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:18.948630 27221 log.cc:824] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:18.952247 27221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: No bootstrap required, opened a new log
I20260806 20:32:18.956864 27225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:18.934481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58902 (local address 127.13.149.126:34885)
0806 20:32:18.935295 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:18.935310 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:18.935359 (+ 49us) server_negotiation.cc:407] Connection header received
0806 20:32:18.937230 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:18.937257 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:18.937756 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:18.938145 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:18.939702 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:18.941829 (+ 2127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:18.943101 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:18.944129 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:18.944330 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:18.948394 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:18.948412 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:18.948432 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:18.948481 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:18.952258 (+ 3777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:18.953045 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:18.953053 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:18.953060 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:18.953282 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:18.953678 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:18.953683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:18.953686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:18.954380 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:18.954686 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:18.955061 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 20:32:18.955489 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":345,"threads_started":1}
I20260806 20:32:18.961161 27221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:18.961462 27221 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:18.961539 27221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7390282a2545ad86e75ad7affe219e, State: Initialized, Role: FOLLOWER
I20260806 20:32:18.961963 27221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:18.962164 27221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:32:18.962255 27221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:32:18.962374 27221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:18.964345 27221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:18.964890 27221 leader_election.cc:302] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a7390282a2545ad86e75ad7affe219e; no voters:
I20260806 20:32:18.965417 27221 leader_election.cc:288] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:32:18.965570 27229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:18.966282 27229 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 LEADER]: Becoming Leader. State: Replica: 6a7390282a2545ad86e75ad7affe219e, State: Running, Role: LEADER
I20260806 20:32:18.966828 27229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:18.967537 27221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:18.969992 27235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a7390282a2545ad86e75ad7affe219e. Latest consensus state: current_term: 1 leader_uuid: "6a7390282a2545ad86e75ad7affe219e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } } }
I20260806 20:32:18.969961 27234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a7390282a2545ad86e75ad7affe219e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } } }
I20260806 20:32:18.970455 27235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:18.970484 27234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:18.973894 27242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:18.978469 27242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:18.985998 27242 catalog_manager.cc:1347] Generated new cluster ID: 6536fdcff1b9489ab5715d892f097842
I20260806 20:32:18.986101 27242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:19.004914 27242 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:32:19.006289 27242 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:19.019435 27242 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Generated new TSK 0
I20260806 20:32:19.020360 27242 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:32:19.087934 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34885
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:19.424011 27260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:19.424270 27260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:19.424363 27260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:19.431385 27260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:19.431486 27260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:19.431593 27260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:19.441107 27260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34885
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:19.442283 27260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:19.443514 27260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:19.456882 27267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:19.456905 27268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:19.457690 27270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:19.458125 27260 server_base.cc:1034] running on GCE node
I20260806 20:32:19.458698 27260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:19.459583 27260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:19.460858 27260 hybrid_clock.cc:648] HybridClock initialized: now 1786048339460801 us; error 55 us; skew 500 ppm
I20260806 20:32:19.461164 27260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:19 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048339, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:19.464259 27260 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:32:19.465704 27260 webserver.cc:460] Webserver started at http://127.13.149.65:37965/ using document root <none> and password file <none>
I20260806 20:32:19.466356 27260 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:19.466512 27260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:19.466827 27260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:19.470031 27260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "02ddc7904c1e488b9a45b008388beba0"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "845e83c1ee11ec09bc916d0f6bb01a05"
server_key_iv: "1126e387ecc0af13180330a3424dd491"
server_key_version: "encryptionkey@0"
I20260806 20:32:19.470803 27260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "02ddc7904c1e488b9a45b008388beba0"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "845e83c1ee11ec09bc916d0f6bb01a05"
server_key_iv: "1126e387ecc0af13180330a3424dd491"
server_key_version: "encryptionkey@0"
I20260806 20:32:19.475967 27260 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:32:19.479534 27283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:19.480837 27260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 20:32:19.481016 27260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "02ddc7904c1e488b9a45b008388beba0"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "845e83c1ee11ec09bc916d0f6bb01a05"
server_key_iv: "1126e387ecc0af13180330a3424dd491"
server_key_version: "encryptionkey@0"
I20260806 20:32:19.481209 27260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:19.503865 27260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:19.507663 27260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:19.507961 27260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:19.508991 27260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:19.510263 27260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:19.510370 27260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:19.510527 27260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:19.510603 27260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:19.544732 27260 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:44459
I20260806 20:32:19.544844 27481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:44459 every 8 connection(s)
I20260806 20:32:19.546322 27260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:19.552160 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 27260
I20260806 20:32:19.552361 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:32:19.553092 13909 external_mini_cluster.cc:1428] Setting key ae74a9ebc43bc62396bb4725419a302f
Aug 06 20:32:19 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048339, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:19.566464 27485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:19.549330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:37467 (local address 127.13.149.126:34885)
0806 20:32:19.549795 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:19.549802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:19.550758 (+ 956us) server_negotiation.cc:407] Connection header received
0806 20:32:19.552549 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:19.552556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:19.552650 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:19.552777 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:19.554452 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:19.555394 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:19.556962 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:19.557361 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:19.557499 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:19.560884 (+ 3385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:19.560889 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:19.560893 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:19.560932 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:19.563505 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:19.564207 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:19.564219 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:19.564221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:19.564339 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:19.564758 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:19.564763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:19.564767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:19.565063 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:19.565227 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:19.565885 (+ 658us) server_negotiation.cc:299] Negotiation successful
0806 20:32:19.566114 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":214,"threads_started":1}
I20260806 20:32:19.567437 27487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:19.549867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:37467)
0806 20:32:19.550588 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:19.550625 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:19.552260 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:19.553054 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:19.553061 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:19.553623 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:19.554283 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:19.554303 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:19.555564 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:19.555570 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:19.556763 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:19.556775 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:19.557599 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:19.557608 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:19.557858 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:19.558527 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:19.558549 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:19.560659 (+ 2110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:19.563647 (+ 2988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:19.563656 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:19.563671 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:19.564081 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:19.564459 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:19.564463 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:19.564467 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:19.564645 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:19.565204 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:19.565211 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:19.565519 (+ 308us) client_negotiation.cc:769] Sending connection context
0806 20:32:19.565778 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 20:32:19.566262 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":267,"threads_started":1}
I20260806 20:32:19.569106 27482 heartbeater.cc:347] Connected to a master server at 127.13.149.126:34885
I20260806 20:32:19.569427 27482 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:19.570116 27482 heartbeater.cc:511] Master 127.13.149.126:34885 requested a full tablet report, sending...
I20260806 20:32:19.572505 27168 ts_manager.cc:194] Registered new tserver with Master: 02ddc7904c1e488b9a45b008388beba0 (127.13.149.65:44459)
I20260806 20:32:19.574666 27168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:37467
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:32:19.612166 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34885
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:19.945375 27491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:19.945637 27491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:19.945796 27491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:19.952960 27491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:19.953085 27491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:19.953275 27491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:19.962780 27491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34885
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:19.964015 27491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:19.965323 27491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:19.978820 27499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:19.978760 27504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:19.978794 27500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:19.979960 27491 server_base.cc:1034] running on GCE node
I20260806 20:32:19.980548 27491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:19.981529 27491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:19.982750 27491 hybrid_clock.cc:648] HybridClock initialized: now 1786048339982712 us; error 50 us; skew 500 ppm
I20260806 20:32:19.983063 27491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:19 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048339, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:19.986327 27491 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:32:19.987697 27491 webserver.cc:460] Webserver started at http://127.13.149.66:37431/ using document root <none> and password file <none>
I20260806 20:32:19.988384 27491 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:19.988524 27491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:19.988910 27491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:19.991758 27491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "28583b6a1dc9473882c0ef65e94f3201"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "ff7fb4f65616a19ac539064649cbb379"
server_key_iv: "b2916deda57c26a8d0b3a4032726edde"
server_key_version: "encryptionkey@0"
I20260806 20:32:19.992550 27491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "28583b6a1dc9473882c0ef65e94f3201"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "ff7fb4f65616a19ac539064649cbb379"
server_key_iv: "b2916deda57c26a8d0b3a4032726edde"
server_key_version: "encryptionkey@0"
I20260806 20:32:19.997516 27491 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:32:20.000743 27513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:20.001958 27491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:20.002140 27491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "28583b6a1dc9473882c0ef65e94f3201"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "ff7fb4f65616a19ac539064649cbb379"
server_key_iv: "b2916deda57c26a8d0b3a4032726edde"
server_key_version: "encryptionkey@0"
I20260806 20:32:20.002346 27491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:20.020658 27491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:20.024968 27491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:20.025264 27491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:20.026240 27491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:20.027544 27491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:20.027647 27491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:20.027798 27491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:20.027871 27491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:20.061625 27491 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:34289
I20260806 20:32:20.061671 27698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:34289 every 8 connection(s)
I20260806 20:32:20.062901 27491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:20.069420 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 27491
I20260806 20:32:20.069607 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:32:20.070050 13909 external_mini_cluster.cc:1428] Setting key d5559edc7c3c8bb0ef132c6c63e19953
Aug 06 20:32:20 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048339, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:20.084654 27485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:20.065437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:53919 (local address 127.13.149.126:34885)
0806 20:32:20.065624 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:20.065628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:20.066738 (+ 1110us) server_negotiation.cc:407] Connection header received
0806 20:32:20.068758 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:20.068765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:20.068885 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:20.069002 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:20.070638 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.071656 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.073529 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.074326 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.074478 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:20.078451 (+ 3973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:20.078456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:20.078459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:20.078497 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:20.081123 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.082031 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.082035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.082037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.082154 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.082633 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.082636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.082638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.082884 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:20.082990 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:20.083919 (+ 929us) server_negotiation.cc:299] Negotiation successful
0806 20:32:20.084166 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":65}
I20260806 20:32:20.085470 27705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:20.065815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:53919)
0806 20:32:20.066568 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:20.066611 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:20.068395 (+ 1784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:20.069244 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:20.069252 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:20.069853 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:20.070458 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:20.070475 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.071852 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.071858 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:20.073371 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:20.073384 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.074538 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.074543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:20.074738 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:20.075442 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:20.075470 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:20.078238 (+ 2768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:20.081259 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:20.081271 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:20.081288 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:20.081920 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:20.082260 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:20.082267 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:20.082274 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:20.082525 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:20.083008 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:20.083018 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:20.083467 (+ 449us) client_negotiation.cc:769] Sending connection context
0806 20:32:20.083793 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 20:32:20.084165 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":280,"threads_started":1}
I20260806 20:32:20.086969 27699 heartbeater.cc:347] Connected to a master server at 127.13.149.126:34885
I20260806 20:32:20.087283 27699 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:20.087978 27699 heartbeater.cc:511] Master 127.13.149.126:34885 requested a full tablet report, sending...
I20260806 20:32:20.089586 27168 ts_manager.cc:194] Registered new tserver with Master: 28583b6a1dc9473882c0ef65e94f3201 (127.13.149.66:34289)
I20260806 20:32:20.090866 27168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:53919
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:32:20.128975 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34885
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:20.466825 27711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:20.467123 27711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:20.467299 27711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:20.474347 27711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:20.474464 27711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:20.474634 27711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:20.483847 27711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34885
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:20.485219 27711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:20.486716 27711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:20.499980 27722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:20.499914 27724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:20.500150 27726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:20.501255 27711 server_base.cc:1034] running on GCE node
I20260806 20:32:20.501902 27711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:20.502782 27711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:20.503980 27711 hybrid_clock.cc:648] HybridClock initialized: now 1786048340503933 us; error 39 us; skew 500 ppm
I20260806 20:32:20.504288 27711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:20 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048340, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:20.507647 27711 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:32:20.509068 27711 webserver.cc:460] Webserver started at http://127.13.149.67:46709/ using document root <none> and password file <none>
I20260806 20:32:20.509708 27711 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:20.509838 27711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:20.510151 27711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:20.513029 27711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "499ce8f757f54e1589d3350744f19e6a"
format_stamp: "Formatted at 2026-08-06 20:32:20 on dist-test-slave-2kcd"
server_key: "d9a6c0af8984a5052e89d18bd8ad3e91"
server_key_iv: "868aee4b002e73d4365ba25ef1bf8fe9"
server_key_version: "encryptionkey@0"
I20260806 20:32:20.513810 27711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "499ce8f757f54e1589d3350744f19e6a"
format_stamp: "Formatted at 2026-08-06 20:32:20 on dist-test-slave-2kcd"
server_key: "d9a6c0af8984a5052e89d18bd8ad3e91"
server_key_iv: "868aee4b002e73d4365ba25ef1bf8fe9"
server_key_version: "encryptionkey@0"
I20260806 20:32:20.518949 27711 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 20:32:20.522261 27734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:20.523456 27711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 20:32:20.523631 27711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "499ce8f757f54e1589d3350744f19e6a"
format_stamp: "Formatted at 2026-08-06 20:32:20 on dist-test-slave-2kcd"
server_key: "d9a6c0af8984a5052e89d18bd8ad3e91"
server_key_iv: "868aee4b002e73d4365ba25ef1bf8fe9"
server_key_version: "encryptionkey@0"
I20260806 20:32:20.523823 27711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:20.547480 27711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:20.552772 27711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:20.553138 27711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:20.554072 27711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:20.555384 27711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:20.555461 27711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:20.555631 27711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:20.555688 27711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:20.577780 27482 heartbeater.cc:503] Master 127.13.149.126:34885 was elected leader, sending a full tablet report...
I20260806 20:32:20.590963 27711 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:39359
I20260806 20:32:20.591051 27924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:39359 every 8 connection(s)
I20260806 20:32:20.592216 27711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:20.602200 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 27711
I20260806 20:32:20.602372 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:32:20.602809 13909 external_mini_cluster.cc:1428] Setting key f38cea85a3ae8f2f04a3fba1f28714bb
Aug 06 20:32:20 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048340, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:20.613195 27927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:20.594962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:45025 (local address 127.13.149.126:34885)
0806 20:32:20.595416 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:20.595421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:20.596387 (+ 966us) server_negotiation.cc:407] Connection header received
0806 20:32:20.598459 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:20.598466 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:20.598557 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:20.598688 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:20.600203 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.601113 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.602837 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.603318 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.603469 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:20.607620 (+ 4151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:20.607625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:20.607628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:20.607661 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:20.610370 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.611083 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.611087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.611089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.611220 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.611629 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.611633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.611635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.611925 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:20.612046 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:20.612662 (+ 616us) server_negotiation.cc:299] Negotiation successful
0806 20:32:20.612886 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":219,"threads_started":1}
I20260806 20:32:20.614192 27928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:20.595475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:45025)
0806 20:32:20.596175 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:20.596255 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:20.598159 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:20.598928 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:20.598936 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:20.599434 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:20.600005 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:20.600023 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.601288 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.601293 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:20.602664 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:20.602685 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.603561 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.603569 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:20.603898 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:20.604672 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:20.604697 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:20.607442 (+ 2745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:20.610511 (+ 3069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:20.610517 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:20.610528 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:20.610962 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:20.611322 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:20.611326 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:20.611328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:20.611506 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:20.612050 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:20.612055 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:20.612344 (+ 289us) client_negotiation.cc:769] Sending connection context
0806 20:32:20.612584 (+ 240us) client_negotiation.cc:240] Negotiation successful
0806 20:32:20.613011 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":273,"threads_started":1}
I20260806 20:32:20.615635 27925 heartbeater.cc:347] Connected to a master server at 127.13.149.126:34885
I20260806 20:32:20.615962 27925 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:20.616708 27925 heartbeater.cc:511] Master 127.13.149.126:34885 requested a full tablet report, sending...
I20260806 20:32:20.618357 27166 ts_manager.cc:194] Registered new tserver with Master: 499ce8f757f54e1589d3350744f19e6a (127.13.149.67:39359)
I20260806 20:32:20.619232 27166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:45025
I20260806 20:32:20.630246 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab.
Entry for principal oryx/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab.
WARNING: no policy specified for oryx/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab.
Entry for principal oryx/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab.
WARNING: no policy specified for oryx/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab.
Entry for principal oryx/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab.
I20260806 20:32:20.782971 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 27260
Aug 06 20:32:20 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:32:20.799271 27943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:20.784360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35924 (local address 127.13.149.65:44459)
0806 20:32:20.785076 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:20.785084 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:20.785111 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:32:20.785181 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:20.785188 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:20.785464 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:20.785625 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:20.786992 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.787997 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.789390 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.789946 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.790043 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:20.793944 (+ 3901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:20.793955 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:20.793970 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:20.794001 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:20.796872 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.797457 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.797463 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.797466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.797599 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.797899 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.797902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.797904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.798211 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:20.798431 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:20.798638 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 20:32:20.798846 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":384,"threads_started":1}
I20260806 20:32:20.800513 27476 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:20.884735 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 27260
I20260806 20:32:20.912616 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 27491
Aug 06 20:32:20 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:32:20.929729 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:20.913509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42316 (local address 127.13.149.66:34289)
0806 20:32:20.914098 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:20.914105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:20.914131 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:32:20.914199 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:20.914204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:20.914440 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:20.914579 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:20.915813 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.917120 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.918415 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:20.918981 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:20.919086 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:20.923121 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:20.923131 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:20.923144 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:20.923179 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:20.926756 (+ 3577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.927394 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.927403 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.927407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.927587 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:20.927981 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:20.927985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:20.927988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:20.928428 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:20.928735 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:20.929055 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 20:32:20.929325 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":324,"threads_started":1}
I20260806 20:32:20.931095 27688 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:21.013733 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 27491
I20260806 20:32:21.036494 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 27711
Aug 06 20:32:21 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:32:21.052407 27950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:21.037507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.13.149.67:39359)
0806 20:32:21.038076 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:21.038084 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:21.038114 (+ 30us) server_negotiation.cc:407] Connection header received
0806 20:32:21.038177 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:21.038183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:21.038412 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:21.038540 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:21.039836 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:21.041003 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:21.042243 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:21.042793 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:21.042890 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:21.047120 (+ 4230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:21.047131 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:21.047146 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:21.047182 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:21.049920 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:21.050505 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:21.050512 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:21.050514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:21.050632 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:21.050939 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:21.050942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:21.050944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:21.051350 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:21.051623 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:21.051807 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 20:32:21.052052 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":263,"threads_started":1}
I20260806 20:32:21.053699 27915 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:21.141626 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 27711
I20260806 20:32:21.164506 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 27117
I20260806 20:32:21.165858 27213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:21.269083 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 27117
I20260806 20:32:21.298382 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:34885
--webserver_interface=127.13.149.126
--webserver_port=45641
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:34885
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:21.629611 27955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:21.629958 27955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:21.630117 27955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:21.637229 27955 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:21.637356 27955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:21.637462 27955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:21.637562 27955 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:21.637656 27955 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:21.647357 27955 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:34885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:34885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=45641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:21.648811 27955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:21.650166 27955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:21.662060 27967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:21.662124 27969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:21.662101 27965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:21.663412 27955 server_base.cc:1034] running on GCE node
I20260806 20:32:21.664224 27955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:21.665632 27955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:21.666867 27955 hybrid_clock.cc:648] HybridClock initialized: now 1786048341666824 us; error 49 us; skew 500 ppm
I20260806 20:32:21.667201 27955 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:21 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048341, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:21.670251 27955 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:32:21.671696 27955 webserver.cc:460] Webserver started at http://127.13.149.126:45641/ using document root <none> and password file <none>
I20260806 20:32:21.672369 27955 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:21.672525 27955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:21.677927 27955 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:32:21.680661 27981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:21.681953 27955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:21.682134 27955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "6a7390282a2545ad86e75ad7affe219e"
format_stamp: "Formatted at 2026-08-06 20:32:18 on dist-test-slave-2kcd"
server_key: "739e0d1e4981c876c15cf8821c6e5e4c"
server_key_iv: "8720d6b3a5ddb27192b15c4b356ad8ed"
server_key_version: "encryptionkey@0"
I20260806 20:32:21.683097 27955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:21.705942 27955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:21.709640 27955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:21.709901 27955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:21.728753 27955 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:34885
I20260806 20:32:21.728821 28065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:34885 every 8 connection(s)
I20260806 20:32:21.730163 27955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:32:21.734555 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 27955
I20260806 20:32:21.735445 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:44459
--local_ip_for_outbound_sockets=127.13.149.65
--tserver_master_addrs=127.13.149.126:34885
--webserver_port=37965
--webserver_interface=127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:32:21.737020 28067 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:32:21.740129 28067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Bootstrap starting.
I20260806 20:32:21.762844 28067 log.cc:824] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:21.774317 28067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:32:21.774914 28067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Bootstrap complete.
I20260806 20:32:21.787710 28067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:21.788548 28067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7390282a2545ad86e75ad7affe219e, State: Initialized, Role: FOLLOWER
I20260806 20:32:21.789248 28067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:21.789498 28067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:32:21.789624 28067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:32:21.789819 28067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 1 FOLLOWER]: Advancing to term 2
I20260806 20:32:21.793598 28067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:21.794081 28067 leader_election.cc:302] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a7390282a2545ad86e75ad7affe219e; no voters:
I20260806 20:32:21.794660 28067 leader_election.cc:288] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 20:32:21.794842 28073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 2 FOLLOWER]: Leader election won for term 2
I20260806 20:32:21.795921 28073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [term 2 LEADER]: Becoming Leader. State: Replica: 6a7390282a2545ad86e75ad7affe219e, State: Running, Role: LEADER
I20260806 20:32:21.796469 28073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } }
I20260806 20:32:21.796729 28067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:21.799373 28075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a7390282a2545ad86e75ad7affe219e. Latest consensus state: current_term: 2 leader_uuid: "6a7390282a2545ad86e75ad7affe219e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } } }
I20260806 20:32:21.799768 28075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:21.800156 28074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6a7390282a2545ad86e75ad7affe219e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7390282a2545ad86e75ad7affe219e" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34885 } } }
I20260806 20:32:21.800458 28074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:21.802744 28087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:21.810310 28087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:21.811959 28087 catalog_manager.cc:1259] Loaded cluster ID: 6536fdcff1b9489ab5715d892f097842
I20260806 20:32:21.812117 28087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:21.819782 28087 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:21.821697 28087 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6a7390282a2545ad86e75ad7affe219e: Loaded TSK: 0
I20260806 20:32:21.823637 28087 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:32:21.823796 28100 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260806 20:32:22.109141 28070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:22.109437 28070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:22.109611 28070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:22.116693 28070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:22.116844 28070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:22.117031 28070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:22.126694 28070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.65.keytab
--principal=oryx/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:44459
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=37965
--tserver_master_addrs=127.13.149.126:34885
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:22.128000 28070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:22.129338 28070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:22.142809 28110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:22.142763 28106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:22.142874 28107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:22.146220 28070 server_base.cc:1034] running on GCE node
I20260806 20:32:22.146806 28070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:22.147778 28070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:22.148974 28070 hybrid_clock.cc:648] HybridClock initialized: now 1786048342148930 us; error 39 us; skew 500 ppm
I20260806 20:32:22.149276 28070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048342, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:22.152504 28070 init.cc:377] Logged in from keytab as oryx/127.13.149.65@KRBTEST.COM (short username oryx)
I20260806 20:32:22.154099 28070 webserver.cc:460] Webserver started at http://127.13.149.65:37965/ using document root <none> and password file <none>
I20260806 20:32:22.154825 28070 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:22.154986 28070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:22.160259 28070 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:22.163098 28124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:22.164439 28070 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:22.164618 28070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "02ddc7904c1e488b9a45b008388beba0"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "845e83c1ee11ec09bc916d0f6bb01a05"
server_key_iv: "1126e387ecc0af13180330a3424dd491"
server_key_version: "encryptionkey@0"
I20260806 20:32:22.165634 28070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:22.182813 28070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:22.187662 28070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:22.187964 28070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:22.188977 28070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:22.190270 28070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:22.190392 28070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:22.190529 28070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:22.190619 28070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:22.224238 28070 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:44459
I20260806 20:32:22.224323 28313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:44459 every 8 connection(s)
I20260806 20:32:22.225723 28070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:22.228832 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 28070
I20260806 20:32:22.229843 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:34289
--local_ip_for_outbound_sockets=127.13.149.66
--tserver_master_addrs=127.13.149.126:34885
--webserver_port=37431
--webserver_interface=127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:22.244324 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:22.228435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:39865)
0806 20:32:22.229363 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:22.229413 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:22.231277 (+ 1864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:22.233116 (+ 1839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:22.233129 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:22.233738 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:22.234251 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.234269 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.235858 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.235862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.237135 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.237148 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.238172 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.238180 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.238459 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.239120 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:22.239141 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:22.243092 (+ 3951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":381,"threads_started":1}
W20260806 20:32:22.244401 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:22.228595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:39865 (local address 127.13.149.126:34885)
0806 20:32:22.231927 (+ 3332us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:22.231939 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:22.231977 (+ 38us) server_negotiation.cc:407] Connection header received
0806 20:32:22.232276 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:22.232288 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:22.232598 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:22.232986 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:22.234456 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.235669 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.237288 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.237930 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.238141 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.243434 (+ 5293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:39865: BlockingRecv error: recv got EOF from 127.13.149.65:39865 (error 108)
Metrics: {"server-negotiator.queue_time_us":3120,"thread_start_us":2917,"threads_started":1}
W20260806 20:32:22.245144 28314 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:34885 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.149.126:34885: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:22.256704 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:22.245715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:59367)
0806 20:32:22.245950 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:22.245975 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:22.246112 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:22.246418 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:22.246426 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:22.246866 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:22.247085 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.247099 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.248089 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.248097 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.249804 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.249822 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.251034 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.251072 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.251375 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.252160 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:22.252219 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:22.256424 (+ 4205us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 20:32:22.257220 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:22.245913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:59367 (local address 127.13.149.126:34885)
0806 20:32:22.246046 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:22.246050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:22.246065 (+ 15us) server_negotiation.cc:407] Connection header received
0806 20:32:22.246232 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:22.246235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:22.246287 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:22.246359 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:22.247224 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.247933 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.250027 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.250799 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.250936 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.256610 (+ 5674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:59367: BlockingRecv error: recv got EOF from 127.13.149.65:59367 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:22.266863 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:22.257585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:39933)
0806 20:32:22.257790 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:22.257813 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:22.257923 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:22.258569 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:22.258575 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:22.258998 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:22.259238 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.259252 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.260236 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.260243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.261926 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.261942 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.262630 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.262638 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.262846 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.263379 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:22.263400 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:22.266599 (+ 3199us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 20:32:22.266959 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:22.257722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:39933 (local address 127.13.149.126:34885)
0806 20:32:22.257899 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:22.257906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:22.257931 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:32:22.258109 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:22.258119 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:22.258245 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:22.258331 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:22.259388 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.260076 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.262090 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.262475 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.262566 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.266763 (+ 4197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:39933: BlockingRecv error: recv got EOF from 127.13.149.65:39933 (error 108)
Metrics: {"server-negotiator.queue_time_us":54,"thread_start_us":384,"threads_started":1}
W20260806 20:32:22.267421 28314 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 20:32:22.585656 28322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:22.586007 28322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:22.586199 28322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:22.593835 28322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:22.593994 28322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:22.594192 28322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:22.604326 28322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.66.keytab
--principal=oryx/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:34289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=37431
--tserver_master_addrs=127.13.149.126:34885
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:22.605712 28322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:22.607118 28322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:22.620947 28330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:22.620961 28329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:22.620909 28333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:22.621964 28322 server_base.cc:1034] running on GCE node
I20260806 20:32:22.622689 28322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:22.623651 28322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:22.624929 28322 hybrid_clock.cc:648] HybridClock initialized: now 1786048342624855 us; error 55 us; skew 500 ppm
I20260806 20:32:22.625269 28322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048342, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:22.628707 28322 init.cc:377] Logged in from keytab as oryx/127.13.149.66@KRBTEST.COM (short username oryx)
I20260806 20:32:22.630195 28322 webserver.cc:460] Webserver started at http://127.13.149.66:37431/ using document root <none> and password file <none>
I20260806 20:32:22.630854 28322 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:22.631021 28322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:22.636161 28322 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:32:22.638731 28342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:22.639966 28322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:22.640156 28322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "28583b6a1dc9473882c0ef65e94f3201"
format_stamp: "Formatted at 2026-08-06 20:32:19 on dist-test-slave-2kcd"
server_key: "ff7fb4f65616a19ac539064649cbb379"
server_key_iv: "b2916deda57c26a8d0b3a4032726edde"
server_key_version: "encryptionkey@0"
I20260806 20:32:22.641136 28322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:22.675362 28322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:22.679595 28322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:22.679874 28322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:22.680891 28322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:22.682183 28322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:22.682304 28322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:22.682432 28322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:22.682518 28322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:22.716809 28322 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:34289
I20260806 20:32:22.716980 28549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:34289 every 8 connection(s)
I20260806 20:32:22.718564 28322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:22.724574 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 28322
I20260806 20:32:22.725374 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:39359
--local_ip_for_outbound_sockets=127.13.149.67
--tserver_master_addrs=127.13.149.126:34885
--webserver_port=46709
--webserver_interface=127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 20:32:22.738992 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:22.721065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:58235 (local address 127.13.149.126:34885)
0806 20:32:22.721247 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:22.721251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:22.722405 (+ 1154us) server_negotiation.cc:407] Connection header received
0806 20:32:22.724050 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:22.724055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:22.724138 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:22.724224 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:22.726269 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.726989 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.729480 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.730145 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.730283 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.738714 (+ 8431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:58235: BlockingRecv error: recv got EOF from 127.13.149.66:58235 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:32:22.739403 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:22.721564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:58235)
0806 20:32:22.722254 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:22.722294 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:22.723819 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:22.724509 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:22.724519 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:22.725275 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:22.726080 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.726107 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.727173 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.727181 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.729283 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.729302 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.730391 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.730400 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.730726 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.731509 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:22.731541 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:22.738481 (+ 6940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":259,"threads_started":1}
W20260806 20:32:22.740118 28550 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:34885 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.149.126:34885: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 20:32:22.748628 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:22.740760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:39357 (local address 127.13.149.126:34885)
0806 20:32:22.740984 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:22.740993 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:22.741016 (+ 23us) server_negotiation.cc:407] Connection header received
0806 20:32:22.741074 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:22.741082 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:22.741170 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:22.741291 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:22.741886 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.742639 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.743826 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.744283 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.744430 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.748434 (+ 4004us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:39357: BlockingRecv error: recv got EOF from 127.13.149.66:39357 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 20:32:22.748694 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:22.740682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:39357)
0806 20:32:22.740881 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:22.740897 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:22.740972 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:22.741304 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:22.741307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:22.741591 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:22.741730 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.741737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.742778 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.742783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.743675 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.743686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.744453 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.744458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.744633 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.745259 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:22.745276 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:22.748285 (+ 3009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:22 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:22.756719 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:22.749471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:40923)
0806 20:32:22.749642 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:22.749661 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:22.749756 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:22.750110 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:22.750115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:22.750395 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:22.750530 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.750538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.751479 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.751486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.752382 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:22.752392 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.753113 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.753118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:22.753298 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.753851 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:22.753868 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:22.756444 (+ 2576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 20:32:22.756889 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:22.749566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:40923 (local address 127.13.149.126:34885)
0806 20:32:22.749723 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:22.749728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:22.749745 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:32:22.749891 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:22.749896 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:22.749967 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:22.750064 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:22.750679 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.751343 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.752535 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:22.752973 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:22.753103 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:22.756630 (+ 3527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:40923: BlockingRecv error: recv got EOF from 127.13.149.66:40923 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 20:32:22.757057 28550 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 20:32:23.067739 28555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:23.068035 28555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:23.068197 28555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:23.075517 28555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:23.075668 28555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:23.075838 28555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:23.085388 28555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/krb5kdc/oryx_127.13.149.67.keytab
--principal=oryx/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:39359
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=46709
--tserver_master_addrs=127.13.149.126:34885
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:23.086721 28555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:23.088063 28555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:23.101080 28561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:23.101154 28568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:23.101120 28565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:23.102170 28555 server_base.cc:1034] running on GCE node
I20260806 20:32:23.102941 28555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:23.103976 28555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:23.105186 28555 hybrid_clock.cc:648] HybridClock initialized: now 1786048343105124 us; error 49 us; skew 500 ppm
I20260806 20:32:23.105530 28555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048343, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:23.108742 28555 init.cc:377] Logged in from keytab as oryx/127.13.149.67@KRBTEST.COM (short username oryx)
I20260806 20:32:23.110201 28555 webserver.cc:460] Webserver started at http://127.13.149.67:46709/ using document root <none> and password file <none>
I20260806 20:32:23.110867 28555 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:23.110981 28555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:23.116319 28555 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:23.118983 28587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:23.120313 28555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:23.120489 28555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "499ce8f757f54e1589d3350744f19e6a"
format_stamp: "Formatted at 2026-08-06 20:32:20 on dist-test-slave-2kcd"
server_key: "d9a6c0af8984a5052e89d18bd8ad3e91"
server_key_iv: "868aee4b002e73d4365ba25ef1bf8fe9"
server_key_version: "encryptionkey@0"
I20260806 20:32:23.121609 28555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:23.148856 28555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:23.153250 28555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:23.153528 28555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:23.154517 28555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:23.155913 28555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:23.156051 28555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:23.156176 28555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:23.156250 28555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:23.190428 28555 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:39359
I20260806 20:32:23.190517 28780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:39359 every 8 connection(s)
I20260806 20:32:23.191886 28555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:23.197337 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 28555
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 20:32:23.209714 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:23.194476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:54033 (local address 127.13.149.126:34885)
0806 20:32:23.194683 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:23.194688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:23.195791 (+ 1103us) server_negotiation.cc:407] Connection header received
0806 20:32:23.198061 (+ 2270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:23.198070 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:23.198170 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:23.198304 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:23.201096 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.201855 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.203418 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.203999 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.204155 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.209391 (+ 5236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:54033: BlockingRecv error: recv got EOF from 127.13.149.67:54033 (error 108)
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":81}
I20260806 20:32:23.210214 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:23.194943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:54033)
0806 20:32:23.195626 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:23.195669 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:23.197716 (+ 2047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:23.199271 (+ 1555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:23.199283 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:23.200057 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:23.200917 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.200945 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.202032 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.202036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.203265 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.203277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.204237 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.204244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.204482 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.205308 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:23.205329 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:23.209158 (+ 3829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":265,"threads_started":1}
W20260806 20:32:23.210846 28783 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:34885 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.149.126:34885: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
I20260806 20:32:23.214396 28792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:23.198626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55152 (local address 127.13.149.126:34885)
0806 20:32:23.199088 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:23.199092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:23.199107 (+ 15us) server_negotiation.cc:407] Connection header received
0806 20:32:23.199276 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:23.199280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:23.199328 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:23.199409 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:23.201436 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.202235 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.203609 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.204125 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.204260 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.207068 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:23.207076 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:23.207090 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:23.207127 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:23.210815 (+ 3688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:23.211849 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:23.211858 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:23.211879 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:23.212107 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:23.212508 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:23.212514 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:23.212517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:23.213136 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:23.213464 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:23.213752 (+ 288us) server_negotiation.cc:299] Negotiation successful
0806 20:32:23.214133 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":373,"thread_start_us":262,"threads_started":1}
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:23.219599 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:23.211377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:41261)
0806 20:32:23.211582 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:23.211604 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:23.211705 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:23.212086 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:23.212090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:23.212367 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:23.212501 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.212510 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.213912 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.213917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.214938 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.214950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.215860 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.215866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.216058 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.216616 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:23.216638 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:23.219323 (+ 2685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 20:32:23.220098 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:23.211624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:41261 (local address 127.13.149.126:34885)
0806 20:32:23.211807 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:23.211812 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:23.211828 (+ 16us) server_negotiation.cc:407] Connection header received
0806 20:32:23.211874 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:23.211879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:23.211949 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:23.212050 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:23.212631 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.213755 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.215088 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.215708 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.215855 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.219516 (+ 3661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:41261: BlockingRecv error: recv got EOF from 127.13.149.67:41261 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:23.227610 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:23.220258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:44177)
0806 20:32:23.220455 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:23.220476 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:23.220580 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:23.221060 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:23.221064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:23.221321 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:23.221492 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.221499 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.222388 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.222391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.223228 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.223237 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.223912 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.223918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.224100 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.224652 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:23.224668 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:23.227318 (+ 2650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 20:32:23.227767 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:23.220353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44177 (local address 127.13.149.126:34885)
0806 20:32:23.220580 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:23.220584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:23.220599 (+ 15us) server_negotiation.cc:407] Connection header received
0806 20:32:23.220687 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:23.220690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:23.220757 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:23.220892 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:23.221615 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.222265 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.223361 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.223768 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.223900 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.227513 (+ 3613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:44177: BlockingRecv error: recv got EOF from 127.13.149.67:44177 (error 108)
Metrics: {"server-negotiator.queue_time_us":133}
W20260806 20:32:23.228256 28783 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:23.277051 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:23.268033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:47145)
0806 20:32:23.268669 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:23.268685 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:23.268842 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:23.269173 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:23.269176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:23.269638 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:23.269898 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.269908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.270863 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.270866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.271828 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.271839 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.272511 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.272515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.272625 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.273204 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:23.273223 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:23.276670 (+ 3447us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":387,"threads_started":1}
W20260806 20:32:23.277161 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:23.268128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:47145 (local address 127.13.149.126:34885)
0806 20:32:23.268320 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:23.268324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:23.268756 (+ 432us) server_negotiation.cc:407] Connection header received
0806 20:32:23.268967 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:23.268971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:23.269038 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:23.269121 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:23.270031 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.270739 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.271942 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.272358 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.272447 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.276915 (+ 4468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:47145: BlockingRecv error: recv got EOF from 127.13.149.65:47145 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:23 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:23.766562 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:23.757701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:37455)
0806 20:32:23.758265 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:23.758281 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:23.758395 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:23.758713 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:23.758716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:23.759209 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:23.759408 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.759417 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.760376 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.760379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.761690 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:23.761706 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.762577 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.762581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:23.762700 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.763258 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:23.763275 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:23.766228 (+ 2953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":327,"threads_started":1}
W20260806 20:32:23.766711 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:23.757786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:37455 (local address 127.13.149.126:34885)
0806 20:32:23.757971 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:23.757975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:23.758354 (+ 379us) server_negotiation.cc:407] Connection header received
0806 20:32:23.758492 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:23.758496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:23.758574 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:23.758653 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:23.759533 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.760246 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.761859 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:23.762407 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:23.762526 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:23.766433 (+ 3907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:37455: BlockingRecv error: recv got EOF from 127.13.149.66:37455 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 20:32:24 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:24 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:24.241518 28797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:24.228830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:41275)
0806 20:32:24.229398 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:24.229414 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:24.229529 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:24.229818 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:24.229821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:24.230255 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:24.230446 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:24.230455 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.231401 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.231404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:24.232372 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:24.232383 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.233156 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.233170 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:24.233290 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:24.238346 (+ 5056us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:24.238373 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:24.241273 (+ 2900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":317,"threads_started":1}
W20260806 20:32:24.241686 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:24.228880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:41275 (local address 127.13.149.126:34885)
0806 20:32:24.229038 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:24.229043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:24.229483 (+ 440us) server_negotiation.cc:407] Connection header received
0806 20:32:24.229624 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:24.229627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:24.229687 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:24.229766 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:24.230571 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.231274 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.232492 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.232990 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.233085 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:24.241459 (+ 8374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:41275: BlockingRecv error: recv got EOF from 127.13.149.67:41275 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 20:32:24 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:24 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:24.286209 28798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:24.277950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:36541)
0806 20:32:24.278560 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:24.278576 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:24.278693 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:24.278981 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:24.278984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:24.279375 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:24.279563 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:24.279573 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.280572 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.280576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:24.281528 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:24.281540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.282192 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.282196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:24.282302 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:24.282861 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:24.282878 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:24.285824 (+ 2946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":354,"threads_started":1}
W20260806 20:32:24.286370 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:24.277983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:36541 (local address 127.13.149.126:34885)
0806 20:32:24.278141 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:24.278146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:24.278648 (+ 502us) server_negotiation.cc:407] Connection header received
0806 20:32:24.278792 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:24.278795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:24.278857 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:24.278937 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:24.279687 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.280446 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.281648 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.282049 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.282150 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:24.286002 (+ 3852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:36541: BlockingRecv error: recv got EOF from 127.13.149.65:36541 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 20:32:24 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:24 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:24.776916 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:24.767609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:34971)
0806 20:32:24.768184 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:24.768200 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:24.768373 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:24.768753 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:24.768757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:24.769224 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:24.769415 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:24.769424 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.770465 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.770473 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:24.771590 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:24.771609 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.772670 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.772677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:24.772882 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:24.773534 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:24.773551 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:24.776539 (+ 2988us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":315,"threads_started":1}
W20260806 20:32:24.777063 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:24.767740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:34971 (local address 127.13.149.126:34885)
0806 20:32:24.768018 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:24.768025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:24.768301 (+ 276us) server_negotiation.cc:407] Connection header received
0806 20:32:24.768512 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:24.768518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:24.768607 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:24.768712 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:24.769567 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.770315 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.771765 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:24.772506 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:24.772638 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:24.776809 (+ 4171us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:34971: BlockingRecv error: recv got EOF from 127.13.149.66:34971 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 06 20:32:25 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:25 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:25.251351 28801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:25.242537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:50523)
0806 20:32:25.243163 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:25.243179 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:25.243331 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:25.243696 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:25.243701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:25.244163 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:25.244335 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:25.244345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.245468 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.245475 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:25.246461 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:25.246473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.247233 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.247239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:25.247415 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:25.247997 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:25.248017 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:25.250993 (+ 2976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":345,"threads_started":1}
W20260806 20:32:25.251478 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:25.242706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:50523 (local address 127.13.149.126:34885)
0806 20:32:25.242992 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:25.243000 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:25.243259 (+ 259us) server_negotiation.cc:407] Connection header received
0806 20:32:25.243461 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:25.243466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:25.243550 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:25.243656 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:25.244482 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.245314 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.246615 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.247055 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.247217 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:25.251207 (+ 3990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:50523: BlockingRecv error: recv got EOF from 127.13.149.67:50523 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 06 20:32:25 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:25 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:25.295413 28802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:25.287205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:37645)
0806 20:32:25.287728 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:25.287748 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:25.287898 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:25.288304 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:25.288311 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:25.288770 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:25.289033 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:25.289047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.290132 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.290136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:25.291057 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:25.291068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.291674 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.291678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:25.291804 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:25.292367 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:25.292384 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:25.295155 (+ 2771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":284,"threads_started":1}
W20260806 20:32:25.295670 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:25.287285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:37645 (local address 127.13.149.126:34885)
0806 20:32:25.287537 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:25.287544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:25.287848 (+ 304us) server_negotiation.cc:407] Connection header received
0806 20:32:25.288067 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:25.288072 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:25.288150 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:25.288234 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:25.289195 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.290006 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.291173 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.291556 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.291645 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:25.295323 (+ 3678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:37645: BlockingRecv error: recv got EOF from 127.13.149.65:37645 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 06 20:32:25 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:25 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:25.786586 28804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:25.778020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:50069)
0806 20:32:25.778494 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:25.778512 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:25.778627 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:25.778920 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:25.778923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:25.779285 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:25.779453 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:25.779462 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.780474 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.780478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:25.781464 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:25.781476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.782158 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.782163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:25.782301 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:25.782959 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:25.782978 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:25.786282 (+ 3304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":275,"threads_started":1}
W20260806 20:32:25.786820 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:25.778088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:50069 (local address 127.13.149.126:34885)
0806 20:32:25.778311 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:25.778320 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:25.778592 (+ 272us) server_negotiation.cc:407] Connection header received
0806 20:32:25.778724 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:25.778728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:25.778793 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:25.778874 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:25.779582 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.780348 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.781590 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:25.782032 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:25.782124 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:25.786522 (+ 4398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:50069: BlockingRecv error: recv got EOF from 127.13.149.66:50069 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 20:32:26 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:26 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:26.263043 28806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:26.252424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:41733)
0806 20:32:26.252995 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:26.253012 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:26.253116 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:26.253805 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:26.253813 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:26.254353 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:26.254619 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:26.254634 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.256010 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.256015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:26.257569 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:26.257586 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.258610 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.258616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:26.258817 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:26.259576 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:26.259830 (+ 254us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:26.262661 (+ 2831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":288,"threads_started":1}
W20260806 20:32:26.263085 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:26.252547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:41733 (local address 127.13.149.126:34885)
0806 20:32:26.253378 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:26.253397 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:26.253418 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:32:26.253470 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:26.253481 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:26.253624 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:26.253750 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:26.254782 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.255860 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.257738 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.258453 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.258585 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:26.262855 (+ 4270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:41733: BlockingRecv error: recv got EOF from 127.13.149.67:41733 (error 108)
Metrics: {"server-negotiator.queue_time_us":669}
Aug 06 20:32:26 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:26 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:26.304425 28810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:26.296258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:35951)
0806 20:32:26.296828 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:26.296843 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:26.296985 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:26.297352 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:26.297357 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:26.297789 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:26.297969 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:26.297978 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.298959 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.298965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:26.299934 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:26.299946 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.300635 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.300641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:26.300863 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:26.301390 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:26.301418 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:26.304184 (+ 2766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":256,"threads_started":1}
W20260806 20:32:26.304622 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:26.296323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:35951 (local address 127.13.149.126:34885)
0806 20:32:26.296553 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:26.296560 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:26.296937 (+ 377us) server_negotiation.cc:407] Connection header received
0806 20:32:26.297138 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:26.297143 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:26.297214 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:26.297315 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:26.298106 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.298817 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.300073 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.300487 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.300610 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:26.304374 (+ 3764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:35951: BlockingRecv error: recv got EOF from 127.13.149.65:35951 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 20:32:26 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:26 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:26.796229 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:26.787650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:46933)
0806 20:32:26.788218 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:26.788234 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:26.788350 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:26.788665 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:26.788668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:26.789077 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:26.789232 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:26.789240 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.790626 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.790631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:26.791606 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:26.791618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.792350 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.792356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:26.792541 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:26.793227 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:26.793246 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:26.795980 (+ 2734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":321,"threads_started":1}
W20260806 20:32:26.796378 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:26.787677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:46933 (local address 127.13.149.126:34885)
0806 20:32:26.787857 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:26.787862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:26.788310 (+ 448us) server_negotiation.cc:407] Connection header received
0806 20:32:26.788449 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:26.788453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:26.788521 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:26.788616 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:26.789369 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.790501 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.791757 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:26.792196 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:26.792336 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:26.796166 (+ 3830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:46933: BlockingRecv error: recv got EOF from 127.13.149.66:46933 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 20:32:27 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:27 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:27.272595 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:27.264072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:51185)
0806 20:32:27.264576 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:27.264591 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:27.264753 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:27.265134 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:27.265138 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:27.265669 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:27.265834 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:27.265842 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.266909 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.266915 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:27.267903 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:27.267914 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.268664 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.268669 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:27.268874 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:27.269533 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:27.269550 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:27.272350 (+ 2800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":271,"threads_started":1}
W20260806 20:32:27.272779 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:27.264135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:51185 (local address 127.13.149.126:34885)
0806 20:32:27.264366 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:27.264375 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:27.264683 (+ 308us) server_negotiation.cc:407] Connection header received
0806 20:32:27.264901 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:27.264906 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:27.264991 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:27.265098 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:27.265984 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.266773 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.268071 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.268489 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.268653 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:27.272546 (+ 3893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:51185: BlockingRecv error: recv got EOF from 127.13.149.67:51185 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 20:32:27 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:27 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:27.314522 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:27.305423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:60143)
0806 20:32:27.305954 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:27.305971 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:27.306130 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:27.306510 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:27.306517 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:27.306996 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:27.307166 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:27.307175 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.308242 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.308249 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:27.309202 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:27.309213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.310050 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.310056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:27.310251 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:27.310976 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:27.311001 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:27.314143 (+ 3142us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":264,"threads_started":1}
W20260806 20:32:27.314571 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:27.305488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:60143 (local address 127.13.149.126:34885)
0806 20:32:27.305710 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:27.305720 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:27.306063 (+ 343us) server_negotiation.cc:407] Connection header received
0806 20:32:27.306267 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:27.306280 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:27.306346 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:27.306446 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:27.307337 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.308093 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.309350 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.309855 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.310016 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:27.314329 (+ 4313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:60143: BlockingRecv error: recv got EOF from 127.13.149.65:60143 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 20:32:27 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:27 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:27.805588 28815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:27.797373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:39045)
0806 20:32:27.797953 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:27.797969 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:27.798117 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:27.798465 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:27.798468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:27.798888 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:27.799072 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:27.799080 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.800031 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.800035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:27.800992 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:27.801009 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.801630 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.801634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:27.801752 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:27.802294 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:27.802310 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:27.805227 (+ 2917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":276,"threads_started":1}
W20260806 20:32:27.805699 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:27.797519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:39045 (local address 127.13.149.126:34885)
0806 20:32:27.797733 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:27.797740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:27.798056 (+ 316us) server_negotiation.cc:407] Connection header received
0806 20:32:27.798277 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:27.798281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:27.798343 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:27.798423 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:27.799190 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.799916 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.801121 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:27.801515 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:27.801606 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:27.805422 (+ 3816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:39045: BlockingRecv error: recv got EOF from 127.13.149.66:39045 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 20:32:28 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:28 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:28.281719 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:28.273584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:60739)
0806 20:32:28.274092 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:28.274109 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:28.274220 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:28.274521 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:28.274524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:28.274914 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:28.275094 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:28.275103 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.276079 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.276083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:28.277050 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:28.277062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.277749 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.277753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:28.277874 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:28.278427 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:28.278443 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:28.281316 (+ 2873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":259,"threads_started":1}
W20260806 20:32:28.281894 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:28.273669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:60739 (local address 127.13.149.126:34885)
0806 20:32:28.273906 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:28.273912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:28.274188 (+ 276us) server_negotiation.cc:407] Connection header received
0806 20:32:28.274314 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:28.274317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:28.274393 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:28.274483 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:28.275222 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.275955 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.277173 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.277630 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.277727 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:28.281543 (+ 3816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:60739: BlockingRecv error: recv got EOF from 127.13.149.67:60739 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 20:32:28 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:28 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:28.324052 28818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:28.315678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:38201)
0806 20:32:28.316239 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:28.316259 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:28.316385 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:28.316756 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:28.316761 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:28.317326 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:28.317543 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:28.317555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.318780 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.318784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:28.319672 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:28.319682 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.320300 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.320304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:28.320422 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:28.321058 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:28.321075 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:28.323841 (+ 2766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":325,"threads_started":1}
W20260806 20:32:28.324288 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:28.315730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:38201 (local address 127.13.149.126:34885)
0806 20:32:28.315927 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:28.315931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:28.316349 (+ 418us) server_negotiation.cc:407] Connection header received
0806 20:32:28.316507 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:28.316514 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:28.316602 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:28.316682 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:28.317710 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.318648 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.319790 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.320174 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.320263 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:28.324038 (+ 3775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:38201: BlockingRecv error: recv got EOF from 127.13.149.65:38201 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 20:32:28 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:28 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:28.814899 28819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:28.806581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:47625)
0806 20:32:28.807111 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:28.807126 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:28.807289 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:28.807666 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:28.807671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:28.808114 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:28.808280 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:28.808289 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.809419 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.809423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:28.810321 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:28.810332 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.811055 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.811061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:28.811237 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:28.811801 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:28.811819 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:28.814671 (+ 2852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":295,"threads_started":1}
W20260806 20:32:28.815290 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:28.806664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:47625 (local address 127.13.149.126:34885)
0806 20:32:28.806909 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:28.806919 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:28.807220 (+ 301us) server_negotiation.cc:407] Connection header received
0806 20:32:28.807421 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:28.807432 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:28.807497 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:28.807627 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:28.808434 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.809265 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.810475 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:28.810888 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:28.811026 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:28.814926 (+ 3900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:47625: BlockingRecv error: recv got EOF from 127.13.149.66:47625 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 06 20:32:29 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:29 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:29.297884 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:29.282967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:40625)
0806 20:32:29.283607 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:29.283624 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:29.283770 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:29.284158 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:29.284162 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:29.284538 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:29.284708 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:29.284717 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.286014 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.286025 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:29.286994 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:29.287006 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.287863 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.287867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:29.288025 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:29.293881 (+ 5856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:29.293903 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:29.297517 (+ 3614us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":364,"threads_started":1}
W20260806 20:32:29.298069 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:29.283036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:40625 (local address 127.13.149.126:34885)
0806 20:32:29.283263 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:29.283269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:29.283712 (+ 443us) server_negotiation.cc:407] Connection header received
0806 20:32:29.283896 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:29.283901 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:29.284006 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:29.284096 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:29.284902 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.285730 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.287147 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.287701 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.287811 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:29.297739 (+ 9928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:40625: BlockingRecv error: recv got EOF from 127.13.149.67:40625 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 06 20:32:29 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:29 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:29.334065 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:29.325089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:48949)
0806 20:32:29.325731 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:29.325755 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:29.325924 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:29.326234 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:29.326237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:29.326662 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:29.326830 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:29.326839 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.327935 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.327939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:29.328916 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:29.328928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.329661 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.329665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:29.329780 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:29.330355 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:29.330372 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:29.333768 (+ 3396us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":263,"threads_started":1}
W20260806 20:32:29.334206 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:29.325102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:48949 (local address 127.13.149.126:34885)
0806 20:32:29.325279 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:29.325283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:29.325871 (+ 588us) server_negotiation.cc:407] Connection header received
0806 20:32:29.326063 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:29.326067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:29.326131 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:29.326217 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:29.327053 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.327784 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.329068 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.329519 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.329626 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:29.333984 (+ 4358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:48949: BlockingRecv error: recv got EOF from 127.13.149.65:48949 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 20:32:29 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:29 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:29.824681 28824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:29.815812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:46683)
0806 20:32:29.816427 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:29.816445 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:29.816611 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:29.817016 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:29.817022 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:29.817516 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:29.817688 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:29.817696 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.818805 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.818811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:29.819741 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:29.819752 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.820471 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.820477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:29.820654 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:29.821217 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:29.821235 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:29.824321 (+ 3086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":265,"threads_started":1}
W20260806 20:32:29.824839 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:29.815918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:46683 (local address 127.13.149.126:34885)
0806 20:32:29.816151 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:29.816159 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:29.816540 (+ 381us) server_negotiation.cc:407] Connection header received
0806 20:32:29.816738 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:29.816743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:29.816855 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:29.816981 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:29.817841 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.818661 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.819905 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:29.820309 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:29.820447 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:29.824551 (+ 4104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:46683: BlockingRecv error: recv got EOF from 127.13.149.66:46683 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 20:32:30 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:30 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:30.308301 28825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:30.299122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:46193)
0806 20:32:30.299718 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:30.299735 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:30.299856 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:30.300345 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:30.300349 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:30.300826 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:30.301021 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:30.301032 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.302116 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.302120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:30.303211 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:30.303225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.304147 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.304155 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:30.304291 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:30.304903 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:30.304922 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:30.308033 (+ 3111us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":273,"threads_started":1}
W20260806 20:32:30.308525 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:30.299131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:46193 (local address 127.13.149.126:34885)
0806 20:32:30.299334 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:30.299342 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:30.299827 (+ 485us) server_negotiation.cc:407] Connection header received
0806 20:32:30.300108 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:30.300112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:30.300187 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:30.300277 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:30.301186 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.301927 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.303405 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.303884 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.304002 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:30.308287 (+ 4285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:46193: BlockingRecv error: recv got EOF from 127.13.149.67:46193 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 06 20:32:30 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:30 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:30.343734 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:30.335100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:35393)
0806 20:32:30.335743 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:30.335766 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:30.335923 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:30.336241 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:30.336245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:30.336629 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:30.336854 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:30.336868 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.338041 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.338046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:30.338967 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:30.338978 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.339816 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.339821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:30.339964 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:30.340660 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:30.340679 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:30.343495 (+ 2816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":339,"threads_started":1}
W20260806 20:32:30.343973 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:30.335236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:35393 (local address 127.13.149.126:34885)
0806 20:32:30.335464 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:30.335472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:30.335884 (+ 412us) server_negotiation.cc:407] Connection header received
0806 20:32:30.336050 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:30.336054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:30.336118 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:30.336199 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:30.337059 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.337844 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.339122 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.339614 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.339735 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:30.343702 (+ 3967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:35393: BlockingRecv error: recv got EOF from 127.13.149.65:35393 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 06 20:32:30 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:30 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:30.834518 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:30.825778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:45995)
0806 20:32:30.826470 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:30.826487 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:30.826660 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:30.827014 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:30.827021 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:30.827437 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:30.827594 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:30.827603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.828843 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.828849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:30.829858 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:30.829870 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.830641 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.830648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:30.830834 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:30.831427 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:30.831444 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:30.834171 (+ 2727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":401,"threads_started":1}
W20260806 20:32:30.834640 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:30.825869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:45995 (local address 127.13.149.126:34885)
0806 20:32:30.826086 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:30.826092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:30.826580 (+ 488us) server_negotiation.cc:407] Connection header received
0806 20:32:30.826786 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:30.826792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:30.826868 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:30.826970 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:30.827745 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.828645 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.830008 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:30.830444 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:30.830599 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:30.834395 (+ 3796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:45995: BlockingRecv error: recv got EOF from 127.13.149.66:45995 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 20:32:31 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:31 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:31.318146 28829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:31.309347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:53737)
0806 20:32:31.309992 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:31.310010 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:31.310131 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:31.310435 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:31.310439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:31.310823 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:31.310986 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:31.310995 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.312031 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.312035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:31.312998 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:31.313011 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.313859 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.313864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:31.313989 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:31.314650 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:31.314670 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:31.317804 (+ 3134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":381,"threads_started":1}
W20260806 20:32:31.318315 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:31.309429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:53737 (local address 127.13.149.126:34885)
0806 20:32:31.309724 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:31.309734 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:31.310100 (+ 366us) server_negotiation.cc:407] Connection header received
0806 20:32:31.310232 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:31.310236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:31.310300 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:31.310380 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:31.311123 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.311861 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.313152 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.313695 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.313796 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:31.318041 (+ 4245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:53737: BlockingRecv error: recv got EOF from 127.13.149.67:53737 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 20:32:31 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:31 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:31.352849 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:31.344718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:49915)
0806 20:32:31.345344 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:31.345361 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:31.345517 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:31.345812 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:31.345815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:31.346226 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:31.346387 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:31.346395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.347383 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.347386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:31.348310 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:31.348320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.348986 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.348990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:31.349122 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:31.349756 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:31.349774 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:31.352539 (+ 2765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":365,"threads_started":1}
W20260806 20:32:31.353031 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:31.344775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:49915 (local address 127.13.149.126:34885)
0806 20:32:31.345024 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:31.345028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:31.345435 (+ 407us) server_negotiation.cc:407] Connection header received
0806 20:32:31.345650 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:31.345653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:31.345716 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:31.345796 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:31.346517 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.347264 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.348434 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.348860 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.348958 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:31.352722 (+ 3764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:49915: BlockingRecv error: recv got EOF from 127.13.149.65:49915 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 20:32:31 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:31 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:31.844653 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:31.835522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:48865)
0806 20:32:31.836073 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:31.836089 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:31.836253 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:31.836738 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:31.836743 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:31.837298 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:31.837679 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:31.837701 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.838906 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.838915 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:31.839927 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:31.839939 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.840623 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.840628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:31.840764 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:31.841411 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:31.841428 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:31.844408 (+ 2980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":288,"threads_started":1}
W20260806 20:32:31.844884 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:31.835581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:48865 (local address 127.13.149.126:34885)
0806 20:32:31.835797 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:31.835805 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:31.836180 (+ 375us) server_negotiation.cc:407] Connection header received
0806 20:32:31.836440 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:31.836446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:31.836554 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:31.836668 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:31.837857 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.838703 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.840067 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:31.840473 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:31.840577 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:31.844600 (+ 4023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:48865: BlockingRecv error: recv got EOF from 127.13.149.66:48865 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 20:32:32 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:32 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:32.327956 28834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:32.319226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:38329)
0806 20:32:32.319744 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:32.319761 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:32.319882 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:32.320192 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:32.320195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:32.320591 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:32.320763 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:32.320771 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.321752 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.321756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:32.322693 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:32.322704 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.323638 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.323644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:32.323888 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:32.324621 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:32.324644 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:32.327700 (+ 3056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":276,"threads_started":1}
W20260806 20:32:32.328110 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:32.319382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:38329 (local address 127.13.149.126:34885)
0806 20:32:32.319631 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:32.319637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:32.319845 (+ 208us) server_negotiation.cc:407] Connection header received
0806 20:32:32.319984 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:32.319989 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:32.320068 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:32.320150 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:32.320913 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.321637 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.322859 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.323431 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.323566 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:32.327885 (+ 4319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:38329: BlockingRecv error: recv got EOF from 127.13.149.67:38329 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 06 20:32:32 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:32 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:32.362766 28836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:32.353888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:55795)
0806 20:32:32.354394 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:32.354409 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:32.354560 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:32.354908 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:32.354913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:32.355316 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:32.355469 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:32.355478 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.356523 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.356531 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:32.357557 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:32.357568 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.358306 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.358312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:32.358477 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:32.359131 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:32.359159 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:32.362436 (+ 3277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":281,"threads_started":1}
W20260806 20:32:32.362898 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:32.354017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:55795 (local address 127.13.149.126:34885)
0806 20:32:32.354250 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:32.354257 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:32.354490 (+ 233us) server_negotiation.cc:407] Connection header received
0806 20:32:32.354697 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:32.354709 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:32.354768 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:32.354867 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:32.355608 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.356380 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.357695 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.358149 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.358285 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:32.362635 (+ 4350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:55795: BlockingRecv error: recv got EOF from 127.13.149.65:55795 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 20:32:32 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:32 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:32.854106 28838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:32.845794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:49605)
0806 20:32:32.846498 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:32.846514 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:32.846669 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:32.847075 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:32.847098 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:32.847570 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:32.847725 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:32.847734 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.848733 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.848737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:32.849710 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:32.849721 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.850370 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.850374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:32.850481 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:32.851067 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:32.851083 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:32.853864 (+ 2781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":496,"threads_started":1}
W20260806 20:32:32.854329 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:32.845900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:49605 (local address 127.13.149.126:34885)
0806 20:32:32.846098 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:32.846105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:32.846604 (+ 499us) server_negotiation.cc:407] Connection header received
0806 20:32:32.846824 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:32.846829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:32.846893 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:32.847020 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:32.847860 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.848623 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.849832 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:32.850242 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:32.850335 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:32.854071 (+ 3736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:49605: BlockingRecv error: recv got EOF from 127.13.149.66:49605 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 20:32:33 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:33 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:33.337620 28839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:33.329018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:54509)
0806 20:32:33.329630 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:33.329646 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:33.329818 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:33.330204 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:33.330212 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:33.330636 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:33.330795 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:33.330804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.331845 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.331851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:33.332850 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:33.332864 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.333572 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.333578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:33.333749 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:33.334392 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:33.334410 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:33.337376 (+ 2966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":346,"threads_started":1}
W20260806 20:32:33.337937 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:33.329190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:54509 (local address 127.13.149.126:34885)
0806 20:32:33.329447 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:33.329455 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:33.329740 (+ 285us) server_negotiation.cc:407] Connection header received
0806 20:32:33.329952 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:33.329958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:33.330028 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:33.330134 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:33.330967 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.331708 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.332989 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.333405 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.333540 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:33.337651 (+ 4111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:54509: BlockingRecv error: recv got EOF from 127.13.149.67:54509 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 06 20:32:33 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:33 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:33.372982 28840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:33.363673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:43485)
0806 20:32:33.364213 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:33.364229 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:33.364386 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:33.364741 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:33.364748 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:33.365198 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:33.365390 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:33.365398 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.366444 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.366450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:33.367665 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:33.367702 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.368848 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.368855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:33.369031 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:33.369757 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:33.369776 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:33.372575 (+ 2799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":320,"threads_started":1}
W20260806 20:32:33.373100 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:33.363731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:43485 (local address 127.13.149.126:34885)
0806 20:32:33.364012 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:33.364020 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:33.364314 (+ 294us) server_negotiation.cc:407] Connection header received
0806 20:32:33.364514 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:33.364522 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:33.364596 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:33.364702 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:33.365531 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.366305 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.367862 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.368649 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.368768 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:33.372811 (+ 4043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:43485: BlockingRecv error: recv got EOF from 127.13.149.65:43485 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 20:32:33 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:33 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:33.863481 28842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:33.854997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:56975)
0806 20:32:33.855551 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:33.855567 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:33.855682 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:33.855991 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:33.855994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:33.856401 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:33.856590 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:33.856599 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.857730 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.857734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:33.858646 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:33.858657 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.859397 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.859401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:33.859530 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:33.860173 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:33.860191 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:33.863107 (+ 2916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":313,"threads_started":1}
W20260806 20:32:33.863612 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:33.855156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:56975 (local address 127.13.149.126:34885)
0806 20:32:33.855330 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:33.855334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:33.855641 (+ 307us) server_negotiation.cc:407] Connection header received
0806 20:32:33.855779 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:33.855782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:33.855842 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:33.855944 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:33.856760 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.857597 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.858813 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:33.859261 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:33.859376 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:33.863366 (+ 3990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:56975: BlockingRecv error: recv got EOF from 127.13.149.66:56975 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 20:32:34 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:34 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:34.350871 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:34.338720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:59635)
0806 20:32:34.339310 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:34.339327 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:34.339451 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:34.339751 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:34.339755 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:34.340165 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:34.340338 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:34.340346 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.341335 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.341339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:34.342316 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:34.342329 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.342971 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.342975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:34.343099 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:34.347652 (+ 4553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:34.347669 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:34.350494 (+ 2825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":351,"threads_started":1}
W20260806 20:32:34.350939 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:34.338775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:59635 (local address 127.13.149.126:34885)
0806 20:32:34.338953 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:34.338958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:34.339402 (+ 444us) server_negotiation.cc:407] Connection header received
0806 20:32:34.339556 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:34.339559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:34.339621 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:34.339707 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:34.340476 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.341216 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.342443 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.342842 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.342932 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:34.350702 (+ 7770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:59635: BlockingRecv error: recv got EOF from 127.13.149.67:59635 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 20:32:34 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:34 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:34.382462 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:34.373945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:57145)
0806 20:32:34.374445 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:34.374461 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:34.374613 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:34.375005 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:34.375011 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:34.375477 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:34.375622 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:34.375631 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.376649 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.376656 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:34.377761 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:34.377774 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.378544 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.378550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:34.378722 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:34.379326 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:34.379344 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:34.382117 (+ 2773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":274,"threads_started":1}
W20260806 20:32:34.382545 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:34.373988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:57145 (local address 127.13.149.126:34885)
0806 20:32:34.374231 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:34.374237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:34.374544 (+ 307us) server_negotiation.cc:407] Connection header received
0806 20:32:34.374762 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:34.374770 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:34.374835 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:34.374969 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:34.375763 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.376505 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.377915 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.378385 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.378533 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:34.382309 (+ 3776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:57145: BlockingRecv error: recv got EOF from 127.13.149.65:57145 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 06 20:32:34 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:34 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:34.873754 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:34.864687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:36845)
0806 20:32:34.865287 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:34.865304 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:34.865431 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:34.865749 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:34.865752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:34.866177 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:34.866349 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:34.866359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.867349 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.867353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:34.868312 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:34.868325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.869130 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.869136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:34.869331 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:34.870010 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:34.870037 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:34.873418 (+ 3381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":362,"threads_started":1}
W20260806 20:32:34.873871 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:34.864738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:36845 (local address 127.13.149.126:34885)
0806 20:32:34.864960 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:34.864964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:34.865381 (+ 417us) server_negotiation.cc:407] Connection header received
0806 20:32:34.865539 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:34.865543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:34.865608 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:34.865691 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:34.866482 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.867205 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.868482 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:34.868942 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:34.869045 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:34.873637 (+ 4592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:36845: BlockingRecv error: recv got EOF from 127.13.149.66:36845 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 06 20:32:35 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:35 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:35.360920 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:35.351963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:56421)
0806 20:32:35.352501 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:35.352518 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:35.352642 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:35.353029 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:35.353033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:35.353428 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:35.353585 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:35.353593 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.354627 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.354632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:35.355615 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:35.355628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.356299 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.356303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:35.356443 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:35.357218 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:35.357237 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:35.360598 (+ 3361us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":306,"threads_started":1}
W20260806 20:32:35.361145 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:35.352146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:56421 (local address 127.13.149.126:34885)
0806 20:32:35.352390 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:35.352396 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:35.352602 (+ 206us) server_negotiation.cc:407] Connection header received
0806 20:32:35.352744 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:35.352747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:35.352877 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:35.352960 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:35.353715 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.354453 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.355745 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.356163 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.356267 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:35.360904 (+ 4637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:56421: BlockingRecv error: recv got EOF from 127.13.149.67:56421 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 06 20:32:35 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:35 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:35.392367 28850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:35.383616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:60359)
0806 20:32:35.384257 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:35.384281 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:35.384443 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:35.384881 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:35.384887 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:35.385329 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:35.385503 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:35.385512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.386588 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.386593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:35.387659 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:35.387678 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.388419 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.388424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:35.388541 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:35.389174 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:35.389192 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:35.392119 (+ 2927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":351,"threads_started":1}
W20260806 20:32:35.392554 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:35.383741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:60359 (local address 127.13.149.126:34885)
0806 20:32:35.384043 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:35.384051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:35.384381 (+ 330us) server_negotiation.cc:407] Connection header received
0806 20:32:35.384595 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:35.384599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:35.384662 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:35.384745 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:35.385636 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.386383 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.387812 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.388238 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.388334 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:35.392304 (+ 3970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:60359: BlockingRecv error: recv got EOF from 127.13.149.65:60359 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 20:32:35 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:35 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:35.883718 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:35.874804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:58245)
0806 20:32:35.875488 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:35.875512 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:35.875657 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:35.876082 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:35.876087 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:35.876549 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:35.876715 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:35.876726 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.877890 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.877896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:35.878844 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:35.878856 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.879621 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.879627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:35.879792 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:35.880382 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:35.880399 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:35.883488 (+ 3089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":325,"threads_started":1}
W20260806 20:32:35.883912 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:35.874944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:58245 (local address 127.13.149.126:34885)
0806 20:32:35.875124 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:35.875128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:35.875592 (+ 464us) server_negotiation.cc:407] Connection header received
0806 20:32:35.875804 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:35.875809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:35.875899 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:35.876031 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:35.876952 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.877739 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.878991 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:35.879414 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:35.879580 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:35.883673 (+ 4093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:58245: BlockingRecv error: recv got EOF from 127.13.149.66:58245 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 20:32:36 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:36 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:36.371060 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:36.361950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:53375)
0806 20:32:36.362551 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:36.362568 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:36.362690 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:36.363013 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:36.363017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:36.363444 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:36.363610 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:36.363619 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.364618 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.364622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:36.365838 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:36.365856 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.366855 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.366862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:36.367047 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:36.367699 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:36.367742 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:36.370812 (+ 3070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":320,"threads_started":1}
W20260806 20:32:36.371286 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:36.362043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:53375 (local address 127.13.149.126:34885)
0806 20:32:36.362232 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:36.362236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:36.362646 (+ 410us) server_negotiation.cc:407] Connection header received
0806 20:32:36.362792 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:36.362796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:36.362860 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:36.362947 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:36.363755 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.364488 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.366019 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.366659 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.366800 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:36.371025 (+ 4225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:53375: BlockingRecv error: recv got EOF from 127.13.149.67:53375 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 20:32:36 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:36 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:36.402094 28856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:36.393358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:43573)
0806 20:32:36.393889 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:36.393906 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:36.394075 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:36.394447 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:36.394453 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:36.394859 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:36.395060 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:36.395070 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.396125 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.396130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:36.397169 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:36.397181 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.397944 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.397949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:36.398136 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:36.398721 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:36.398739 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:36.401662 (+ 2923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":263,"threads_started":1}
W20260806 20:32:36.402181 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:36.393446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:43573 (local address 127.13.149.126:34885)
0806 20:32:36.393828 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:36.393834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:36.393988 (+ 154us) server_negotiation.cc:407] Connection header received
0806 20:32:36.394220 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:36.394225 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:36.394300 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:36.394407 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:36.395212 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.395974 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.397325 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.397792 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.397934 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:36.401894 (+ 3960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:43573: BlockingRecv error: recv got EOF from 127.13.149.65:43573 (error 108)
Metrics: {"server-negotiator.queue_time_us":227}
Aug 06 20:32:36 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:36 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:36.893566 28857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:36.884651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:45911)
0806 20:32:36.885262 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:36.885284 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:36.885432 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:36.885799 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:36.885803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:36.886158 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:36.886341 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:36.886350 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.887504 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.887508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:36.888451 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:36.888464 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.889359 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.889364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:36.889503 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:36.890194 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:36.890213 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:36.893208 (+ 2995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":319,"threads_started":1}
W20260806 20:32:36.893622 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:36.884737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:45911 (local address 127.13.149.126:34885)
0806 20:32:36.885003 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:36.885011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:36.885390 (+ 379us) server_negotiation.cc:407] Connection header received
0806 20:32:36.885563 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:36.885569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:36.885665 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:36.885759 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:36.886534 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.887359 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.888620 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:36.889219 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:36.889325 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:36.893405 (+ 4080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:45911: BlockingRecv error: recv got EOF from 127.13.149.66:45911 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 20:32:37 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:37 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.67@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:37.380750 28859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:37.372035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.67:39375)
0806 20:32:37.372543 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:37.372559 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:37.372727 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:37.373115 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:37.373122 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:37.373524 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:37.373711 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:37.373720 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.374745 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.374751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:37.375654 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:37.375666 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.376392 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.376398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:37.376575 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:37.377270 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:37.377288 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:37.380395 (+ 3107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":260,"threads_started":1}
W20260806 20:32:37.380956 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:37.372097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:39375 (local address 127.13.149.126:34885)
0806 20:32:37.372341 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:37.372349 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:37.372650 (+ 301us) server_negotiation.cc:407] Connection header received
0806 20:32:37.372889 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:37.372894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:37.372968 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:37.373073 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:37.373861 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.374591 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.375806 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.376247 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.376380 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:37.380656 (+ 4276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.67:39375: BlockingRecv error: recv got EOF from 127.13.149.67:39375 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 20:32:37 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:37 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.65@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:37.412243 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:37.403544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.65:52095)
0806 20:32:37.404575 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:37.404600 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:37.404744 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:37.405150 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:37.405153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:37.405554 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:37.405747 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:37.405757 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.406768 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.406772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:37.407712 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:37.407723 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.408422 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.408426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:37.408551 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:37.409184 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:37.409202 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:37.411979 (+ 2777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":905,"thread_start_us":743,"threads_started":1}
W20260806 20:32:37.412388 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:37.403598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:52095 (local address 127.13.149.126:34885)
0806 20:32:37.403869 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:37.403879 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:37.404671 (+ 792us) server_negotiation.cc:407] Connection header received
0806 20:32:37.404928 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:37.404933 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:37.405015 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:37.405092 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:37.405896 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.406624 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.407834 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.408259 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.408351 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:37.412175 (+ 3824us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.65:52095: BlockingRecv error: recv got EOF from 127.13.149.65:52095 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 20:32:37 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 20:32:37 dist-test-slave-2kcd krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.149.66@KRBTEST.COM for oryx/127.13.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 20:32:37.903604 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:37.894930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34885 (local address 127.13.149.66:53631)
0806 20:32:37.895435 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:37.895451 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:37.895567 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:37.895852 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:37.895855 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:37.896275 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:37.896444 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:37.896453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.897871 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.897875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:37.899137 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:37.899149 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.899843 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.899847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:37.899975 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:37.900536 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:37.900552 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:37.903327 (+ 2775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.149.126:34885: Server oryx/127.13.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":259,"threads_started":1}
W20260806 20:32:37.903748 28319 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:37.894967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:53631 (local address 127.13.149.126:34885)
0806 20:32:37.895201 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:37.895210 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:37.895536 (+ 326us) server_negotiation.cc:407] Connection header received
0806 20:32:37.895663 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:37.895667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:37.895728 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:37.895806 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:37.896595 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.897706 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.899261 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:37.899720 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:37.899816 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:37.903526 (+ 3710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.149.66:53631: BlockingRecv error: recv got EOF from 127.13.149.66:53631 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 20:32:38.203917 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 28070
I20260806 20:32:38.215837 28866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:38.205037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45396 (local address 127.13.149.65:44459)
0806 20:32:38.205562 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:38.205569 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:38.205595 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:32:38.205652 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:38.205659 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:38.205902 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:38.206055 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:38.207486 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:38.208492 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:38.209724 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:38.210296 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:38.210401 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:38.212929 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:38.212939 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:38.212953 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:38.212988 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:38.215342 (+ 2354us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 20:32:38.215589 (+ 247us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45396: Request ticket server kudu/127.13.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":238,"threads_started":1}
W20260806 20:32:38.215958 28866 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45396: Request ticket server kudu/127.13.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 20:32:38.216018 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 28070: Not authorized: Client connection negotiation failed: client connection to 127.13.149.65:44459: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 20:32:38.216271 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 28070
I20260806 20:32:38.247625 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 28322
I20260806 20:32:38.263876 28867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:38.249017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52706 (local address 127.13.149.66:34289)
0806 20:32:38.249963 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:38.249978 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:38.250039 (+ 61us) server_negotiation.cc:407] Connection header received
0806 20:32:38.250151 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:38.250161 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:38.250531 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:38.250761 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:38.252420 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:38.253940 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:38.255829 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:38.256840 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:38.256976 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:38.260697 (+ 3721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:38.260707 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:38.260722 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:38.260758 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:38.263178 (+ 2420us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 20:32:38.263514 (+ 336us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52706: Request ticket server kudu/127.13.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":391,"threads_started":1}
W20260806 20:32:38.263980 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 28322: Not authorized: Client connection negotiation failed: client connection to 127.13.149.66:34289: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 20:32:38.264014 28867 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52706: Request ticket server kudu/127.13.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 20:32:38.264137 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 28322
I20260806 20:32:38.292747 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 28555
I20260806 20:32:38.305047 28868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:38.293734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.13.149.67:39359)
0806 20:32:38.294366 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:38.294374 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:38.294401 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:32:38.294465 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:38.294472 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:38.294691 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:38.294849 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:38.296171 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:38.297347 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:38.298657 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:38.299226 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:38.299342 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:38.301847 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:38.301855 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:38.301869 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:38.301902 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:38.304465 (+ 2563us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 20:32:38.304723 (+ 258us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53496: Request ticket server kudu/127.13.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":319,"threads_started":1}
W20260806 20:32:38.305166 28868 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53496: Request ticket server kudu/127.13.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 20:32:38.305291 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 28555: Not authorized: Client connection negotiation failed: client connection to 127.13.149.67:39359: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 20:32:38.305507 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 28555
I20260806 20:32:38.331658 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 27955
I20260806 20:32:38.333232 28057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:38.451925 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 27955
2026-08-06T20:32:38Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21575 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T20:32:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:32:38Z Disabled control of system clock
I20260806 20:32:38.551208 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:37737
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:33397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:37737
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 20:32:38.920578 28876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:38.920972 28876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:38.921077 28876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:38.928481 28876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:38.928612 28876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:38.928658 28876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:38.928725 28876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:38.928826 28876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:38.938272 28876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:37737
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:37737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:38.939639 28876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:38.941615 28876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:38.954602 28887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:38.954728 28891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:38.954641 28889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:38.955543 28876 server_base.cc:1034] running on GCE node
I20260806 20:32:38.956405 28876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:38.958019 28876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:38.959292 28876 hybrid_clock.cc:648] HybridClock initialized: now 1786048358959225 us; error 48 us; skew 500 ppm
I20260806 20:32:38.959698 28876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:38.962153 28876 webserver.cc:460] Webserver started at http://127.13.149.126:35227/ using document root <none> and password file <none>
I20260806 20:32:38.963001 28876 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:38.963147 28876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:38.963536 28876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:38.966749 28876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "d21c5afc3e0a4a54acd60e9389f7c25a"
format_stamp: "Formatted at 2026-08-06 20:32:38 on dist-test-slave-2kcd"
server_key: "24e7c2a5cbf100849373bc5664ed55e8"
server_key_iv: "867d3c0987ca7f395e907e9ea0c82686"
server_key_version: "encryptionkey@0"
I20260806 20:32:38.967679 28876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "d21c5afc3e0a4a54acd60e9389f7c25a"
format_stamp: "Formatted at 2026-08-06 20:32:38 on dist-test-slave-2kcd"
server_key: "24e7c2a5cbf100849373bc5664ed55e8"
server_key_iv: "867d3c0987ca7f395e907e9ea0c82686"
server_key_version: "encryptionkey@0"
I20260806 20:32:38.973301 28876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 20:32:38.976917 28905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:38.978294 28876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:32:38.978484 28876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "d21c5afc3e0a4a54acd60e9389f7c25a"
format_stamp: "Formatted at 2026-08-06 20:32:38 on dist-test-slave-2kcd"
server_key: "24e7c2a5cbf100849373bc5664ed55e8"
server_key_iv: "867d3c0987ca7f395e907e9ea0c82686"
server_key_version: "encryptionkey@0"
I20260806 20:32:38.978667 28876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:39.003413 28876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:39.004271 28876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:39.004534 28876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:39.023545 28876 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:37737
I20260806 20:32:39.023568 28977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:37737 every 8 connection(s)
I20260806 20:32:39.025012 28876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:32:39.028672 28980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:39.029608 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 28876
I20260806 20:32:39.029811 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:32:39.030509 13909 external_mini_cluster.cc:1428] Setting key 0ecde88fe1db2aaeb959967c4ec77fc2
I20260806 20:32:39.043512 28980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a: Bootstrap starting.
I20260806 20:32:39.045730 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:39.032622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33236 (local address 127.13.149.126:37737)
0806 20:32:39.033811 (+ 1189us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:39.033825 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:39.033883 (+ 58us) server_negotiation.cc:407] Connection header received
0806 20:32:39.035587 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:39.035615 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:39.036198 (+ 583us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:39.036645 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:39.037284 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:39.039145 (+ 1861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:39.040462 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:39.041580 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:39.041745 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:39.042886 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:39.042896 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:39.042913 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:39.043632 (+ 719us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:39.043729 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:39.043753 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:39.043876 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:39.044102 (+ 226us) server_negotiation.cc:299] Negotiation successful
0806 20:32:39.044415 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":408,"threads_started":1}
I20260806 20:32:39.047354 28980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:39.048728 28980 log.cc:824] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:39.051405 28980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a: No bootstrap required, opened a new log
I20260806 20:32:39.059363 28980 raft_consensus.cc:348] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37737 } }
I20260806 20:32:39.059842 28980 raft_consensus.cc:374] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:39.060027 28980 raft_consensus.cc:729] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d21c5afc3e0a4a54acd60e9389f7c25a, State: Initialized, Role: FOLLOWER
I20260806 20:32:39.060770 28980 consensus_queue.cc:260] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37737 } }
I20260806 20:32:39.061107 28980 raft_consensus.cc:388] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:32:39.061275 28980 raft_consensus.cc:482] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:32:39.061476 28980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:39.063714 28980 raft_consensus.cc:504] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37737 } }
I20260806 20:32:39.064260 28980 leader_election.cc:302] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d21c5afc3e0a4a54acd60e9389f7c25a; no voters:
I20260806 20:32:39.065056 28980 leader_election.cc:288] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:32:39.065212 28990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:39.065954 28990 raft_consensus.cc:686] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [term 1 LEADER]: Becoming Leader. State: Replica: d21c5afc3e0a4a54acd60e9389f7c25a, State: Running, Role: LEADER
I20260806 20:32:39.066494 28990 consensus_queue.cc:237] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37737 } }
I20260806 20:32:39.067343 28980 sys_catalog.cc:564] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:39.069490 28991 sys_catalog.cc:455] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37737 } } }
I20260806 20:32:39.069605 28992 sys_catalog.cc:455] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d21c5afc3e0a4a54acd60e9389f7c25a. Latest consensus state: current_term: 1 leader_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21c5afc3e0a4a54acd60e9389f7c25a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37737 } } }
I20260806 20:32:39.069936 28991 sys_catalog.cc:458] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:39.070062 28992 sys_catalog.cc:458] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:39.071969 29001 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:39.077431 29001 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:39.087384 29001 catalog_manager.cc:1347] Generated new cluster ID: 391a118685f24830984865be4f7455fa
I20260806 20:32:39.087544 29001 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:39.097059 29001 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:32:39.098253 29001 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:39.106263 29001 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d21c5afc3e0a4a54acd60e9389f7c25a: Generated new TSK 0
I20260806 20:32:39.107055 29001 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:32:39.120405 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37737
--builtin_ntp_servers=127.13.149.84:33397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 20:32:39.483337 29024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:39.483660 29024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:39.483750 29024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:39.491204 29024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:39.491317 29024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:39.491426 29024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:39.500872 29024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37737
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:39.502285 29024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:39.504194 29024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:39.518422 29034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:39.518573 29035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:39.518594 29038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:39.519462 29024 server_base.cc:1034] running on GCE node
I20260806 20:32:39.520147 29024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:39.521235 29024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:39.522480 29024 hybrid_clock.cc:648] HybridClock initialized: now 1786048359522423 us; error 66 us; skew 500 ppm
I20260806 20:32:39.522828 29024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:39.528656 29024 webserver.cc:460] Webserver started at http://127.13.149.65:39753/ using document root <none> and password file <none>
I20260806 20:32:39.529475 29024 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:39.529620 29024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:39.529969 29024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:39.533046 29024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "6732d97e45e542dba2228739664fcf68"
format_stamp: "Formatted at 2026-08-06 20:32:39 on dist-test-slave-2kcd"
server_key: "d5e9ef80a94696920a5d4841b126861f"
server_key_iv: "870a6d315308f5e7df227c4f879f594e"
server_key_version: "encryptionkey@0"
I20260806 20:32:39.533875 29024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "6732d97e45e542dba2228739664fcf68"
format_stamp: "Formatted at 2026-08-06 20:32:39 on dist-test-slave-2kcd"
server_key: "d5e9ef80a94696920a5d4841b126861f"
server_key_iv: "870a6d315308f5e7df227c4f879f594e"
server_key_version: "encryptionkey@0"
I20260806 20:32:39.539265 29024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:32:39.542835 29046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:39.544370 29024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:39.544570 29024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "6732d97e45e542dba2228739664fcf68"
format_stamp: "Formatted at 2026-08-06 20:32:39 on dist-test-slave-2kcd"
server_key: "d5e9ef80a94696920a5d4841b126861f"
server_key_iv: "870a6d315308f5e7df227c4f879f594e"
server_key_version: "encryptionkey@0"
I20260806 20:32:39.544828 29024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:39.559255 29024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:39.560177 29024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:39.560501 29024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:39.561579 29024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:39.563194 29024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:39.563324 29024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:39.563484 29024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:39.563581 29024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:39.599399 29024 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:36471
I20260806 20:32:39.599462 29238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:36471 every 8 connection(s)
I20260806 20:32:39.600750 29024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:39.605813 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 29024
I20260806 20:32:39.606030 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:32:39.606820 13909 external_mini_cluster.cc:1428] Setting key ffc3c5aa836cbcb82077626b9b0cac35
I20260806 20:32:39.609615 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37737
--builtin_ntp_servers=127.13.149.84:33397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 20:32:39.614060 29247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:39.603527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:54745 (local address 127.13.149.126:37737)
0806 20:32:39.603999 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:39.604005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:39.605164 (+ 1159us) server_negotiation.cc:407] Connection header received
0806 20:32:39.607203 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:39.607209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:39.607305 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:39.607427 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:39.608703 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:39.609491 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:39.611135 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:39.611558 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:39.611700 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:39.613165 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:39.613170 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:39.613173 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:39.613191 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:39.613230 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:39.613242 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:39.613341 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:39.613576 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 20:32:39.613679 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":239,"threads_started":1}
I20260806 20:32:39.615097 29250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:39.604104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:37737 (local address 127.13.149.65:54745)
0806 20:32:39.604986 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:39.605044 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:39.606883 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:39.607675 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:39.607683 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:39.607770 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:39.608507 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:39.608539 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:39.609658 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:39.609663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:39.610969 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:39.610981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:39.611791 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:39.611799 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:39.612036 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:39.612769 (+ 733us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:32:39.612771 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:39.612869 (+ 98us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:32:39.612948 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:39.613342 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:39.613356 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:39.613366 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 20:32:39.613566 (+ 200us) client_negotiation.cc:240] Negotiation successful
0806 20:32:39.613970 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":279,"threads_started":1}
I20260806 20:32:39.616850 29240 heartbeater.cc:347] Connected to a master server at 127.13.149.126:37737
I20260806 20:32:39.617161 29240 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:39.617959 29240 heartbeater.cc:511] Master 127.13.149.126:37737 requested a full tablet report, sending...
I20260806 20:32:39.621265 28931 ts_manager.cc:194] Registered new tserver with Master: 6732d97e45e542dba2228739664fcf68 (127.13.149.65:36471)
I20260806 20:32:39.623399 28931 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.65:54745
W20260806 20:32:40.164587 29251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:40.165161 29251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:40.165426 29251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:40.177798 29251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:40.177958 29251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:40.178328 29251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:40.193686 29251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37737
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:40.195933 29251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:40.199008 29251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:40.220887 29261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:40.220842 29256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:40.220983 29259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:40.226909 29251 server_base.cc:1034] running on GCE node
I20260806 20:32:40.228065 29251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:40.229818 29251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:40.231340 29251 hybrid_clock.cc:648] HybridClock initialized: now 1786048360231245 us; error 67 us; skew 500 ppm
I20260806 20:32:40.231925 29251 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:40.236331 29251 webserver.cc:460] Webserver started at http://127.13.149.66:44341/ using document root <none> and password file <none>
I20260806 20:32:40.237718 29251 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:40.237942 29251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:40.238528 29251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:40.243794 29251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "ed8d9afef35a4a21889924629be4331f"
format_stamp: "Formatted at 2026-08-06 20:32:40 on dist-test-slave-2kcd"
server_key: "965103c81aaf0e5297b4cdc6841a373c"
server_key_iv: "bfdad82ae173d08e0545107cd7330321"
server_key_version: "encryptionkey@0"
I20260806 20:32:40.245342 29251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "ed8d9afef35a4a21889924629be4331f"
format_stamp: "Formatted at 2026-08-06 20:32:40 on dist-test-slave-2kcd"
server_key: "965103c81aaf0e5297b4cdc6841a373c"
server_key_iv: "bfdad82ae173d08e0545107cd7330321"
server_key_version: "encryptionkey@0"
I20260806 20:32:40.256192 29251 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.004s sys 0.004s
I20260806 20:32:40.264642 29276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:40.269732 29251 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.001s
I20260806 20:32:40.270056 29251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "ed8d9afef35a4a21889924629be4331f"
format_stamp: "Formatted at 2026-08-06 20:32:40 on dist-test-slave-2kcd"
server_key: "965103c81aaf0e5297b4cdc6841a373c"
server_key_iv: "bfdad82ae173d08e0545107cd7330321"
server_key_version: "encryptionkey@0"
I20260806 20:32:40.270438 29251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:40.304557 29251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:40.306203 29251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:40.306779 29251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:40.308604 29251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:40.312076 29251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:40.312178 29251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:40.312314 29251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:40.312424 29251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:40.372092 29251 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:36201
I20260806 20:32:40.372159 29459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:36201 every 8 connection(s)
I20260806 20:32:40.374703 29251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:40.380714 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 29251
I20260806 20:32:40.381052 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:32:40.382309 13909 external_mini_cluster.cc:1428] Setting key bc7b29e230852478bd9ee7ecae301d16
I20260806 20:32:40.388152 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37737
--builtin_ntp_servers=127.13.149.84:33397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 20:32:40.402032 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:40.378837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:38497 (local address 127.13.149.126:37737)
0806 20:32:40.379635 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:40.379642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:40.382278 (+ 2636us) server_negotiation.cc:407] Connection header received
0806 20:32:40.386792 (+ 4514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:40.386797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:40.386923 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:40.387080 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:40.390092 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:40.391241 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:40.396210 (+ 4969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:40.397209 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:40.397420 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:40.400594 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:40.400608 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:40.400612 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:40.400651 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:40.400722 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:40.400748 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:40.400953 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:40.401427 (+ 474us) server_negotiation.cc:299] Negotiation successful
0806 20:32:40.401585 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":415,"threads_started":1}
I20260806 20:32:40.405297 29466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:40.379873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:37737 (local address 127.13.149.66:38497)
0806 20:32:40.381957 (+ 2084us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:40.382059 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:40.386254 (+ 4195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:40.387587 (+ 1333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:40.387618 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:40.387888 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:40.389746 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:40.389801 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:40.391459 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:40.391467 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:40.395930 (+ 4463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:40.395962 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:40.397636 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:40.397648 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:40.398393 (+ 745us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:40.399854 (+ 1461us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:32:40.399872 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:40.399983 (+ 111us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:32:40.400204 (+ 221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:40.400983 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:40.401011 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:40.401045 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 20:32:40.401420 (+ 375us) client_negotiation.cc:240] Negotiation successful
0806 20:32:40.402293 (+ 873us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":930,"thread_start_us":509,"threads_started":1}
I20260806 20:32:40.407867 29462 heartbeater.cc:347] Connected to a master server at 127.13.149.126:37737
I20260806 20:32:40.408419 29462 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:40.409862 29462 heartbeater.cc:511] Master 127.13.149.126:37737 requested a full tablet report, sending...
I20260806 20:32:40.412943 28931 ts_manager.cc:194] Registered new tserver with Master: ed8d9afef35a4a21889924629be4331f (127.13.149.66:36201)
I20260806 20:32:40.415326 28931 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.66:38497
I20260806 20:32:40.628612 29240 heartbeater.cc:503] Master 127.13.149.126:37737 was elected leader, sending a full tablet report...
W20260806 20:32:40.963227 29467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:40.963718 29467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:40.963869 29467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:40.976851 29467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:40.977120 29467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:40.977402 29467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:40.992937 29467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37737
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:40.995092 29467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:40.998253 29467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:41.023049 29478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:41.023087 29480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:41.025244 29467 server_base.cc:1034] running on GCE node
W20260806 20:32:41.025866 29487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:41.027211 29467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:41.029444 29467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:41.030795 29467 hybrid_clock.cc:648] HybridClock initialized: now 1786048361030694 us; error 66 us; skew 500 ppm
I20260806 20:32:41.031517 29467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:41.036629 29467 webserver.cc:460] Webserver started at http://127.13.149.67:42867/ using document root <none> and password file <none>
I20260806 20:32:41.038260 29467 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:41.038468 29467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:41.039165 29467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:41.044237 29467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "45ec6d225f8747f69304bc5d90bfb035"
format_stamp: "Formatted at 2026-08-06 20:32:41 on dist-test-slave-2kcd"
server_key: "a0bcb9558f0093c6ccb8758aea1414f4"
server_key_iv: "951dba8a86facebc256a6f4cf02018f7"
server_key_version: "encryptionkey@0"
I20260806 20:32:41.045728 29467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "45ec6d225f8747f69304bc5d90bfb035"
format_stamp: "Formatted at 2026-08-06 20:32:41 on dist-test-slave-2kcd"
server_key: "a0bcb9558f0093c6ccb8758aea1414f4"
server_key_iv: "951dba8a86facebc256a6f4cf02018f7"
server_key_version: "encryptionkey@0"
I20260806 20:32:41.056082 29467 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.004s
I20260806 20:32:41.062330 29496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:41.064594 29467 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260806 20:32:41.064913 29467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "45ec6d225f8747f69304bc5d90bfb035"
format_stamp: "Formatted at 2026-08-06 20:32:41 on dist-test-slave-2kcd"
server_key: "a0bcb9558f0093c6ccb8758aea1414f4"
server_key_iv: "951dba8a86facebc256a6f4cf02018f7"
server_key_version: "encryptionkey@0"
I20260806 20:32:41.065292 29467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:41.099987 29467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:41.101765 29467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:41.102370 29467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:41.104228 29467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:41.106968 29467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:41.107223 29467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:41.107419 29467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:41.107622 29467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:41.172540 29467 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:36835
I20260806 20:32:41.172600 29679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:36835 every 8 connection(s)
I20260806 20:32:41.175201 29467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:41.183450 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 29467
I20260806 20:32:41.183740 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:32:41.184931 13909 external_mini_cluster.cc:1428] Setting key 8a96937fa52ab9ece6925fa0c03e3ede
I20260806 20:32:41.200400 29683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:41.179721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:47891 (local address 127.13.149.126:37737)
0806 20:32:41.180480 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:41.180485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:41.182910 (+ 2425us) server_negotiation.cc:407] Connection header received
0806 20:32:41.187563 (+ 4653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:41.187572 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:41.187740 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:41.187967 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:41.190992 (+ 3025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.192118 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.195072 (+ 2954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.195837 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.196128 (+ 291us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:41.198644 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:41.198650 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:41.198654 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:41.198682 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:41.198757 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:41.198781 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:41.199011 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:41.199435 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 20:32:41.199612 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":349,"threads_started":1}
I20260806 20:32:41.202657 29685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:41.180932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:37737 (local address 127.13.149.67:47891)
0806 20:32:41.182591 (+ 1659us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:41.182689 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:41.186957 (+ 4268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:41.188386 (+ 1429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:41.188419 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:41.188771 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:41.190647 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:41.190672 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.192391 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.192399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:41.194774 (+ 2375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:41.194796 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.196310 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.196319 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:41.196992 (+ 673us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:41.198071 (+ 1079us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:32:41.198094 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:41.198206 (+ 112us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:32:41.198332 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:41.199000 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:41.199014 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:41.199036 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 20:32:41.199414 (+ 378us) client_negotiation.cc:240] Negotiation successful
0806 20:32:41.200193 (+ 779us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":484,"threads_started":1}
I20260806 20:32:41.205134 29680 heartbeater.cc:347] Connected to a master server at 127.13.149.126:37737
I20260806 20:32:41.205665 29680 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:41.206933 29680 heartbeater.cc:511] Master 127.13.149.126:37737 requested a full tablet report, sending...
I20260806 20:32:41.209298 28931 ts_manager.cc:194] Registered new tserver with Master: 45ec6d225f8747f69304bc5d90bfb035 (127.13.149.67:36835)
I20260806 20:32:41.210834 28931 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.67:47891
I20260806 20:32:41.218109 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 20:32:41.229693 29683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:41.226604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60020 (local address 127.13.149.126:37737)
0806 20:32:41.226858 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:41.226874 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:41.227848 (+ 974us) server_negotiation.cc:407] Connection header received
0806 20:32:41.228129 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:41.228142 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:41.228237 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:41.228363 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:41.229071 (+ 708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60020: BlockingRecv error: recv got EOF from 127.0.0.1:60020 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 20:32:41.231235 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 29024
I20260806 20:32:41.245272 29697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:41.233057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49022 (local address 127.13.149.65:36471)
0806 20:32:41.234210 (+ 1153us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:41.234222 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:41.234268 (+ 46us) server_negotiation.cc:407] Connection header received
0806 20:32:41.234363 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:41.234372 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:41.234771 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:41.235012 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:41.235521 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.237345 (+ 1824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.239698 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.240772 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.241039 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:41.242775 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:41.242785 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:41.242809 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:41.243799 (+ 990us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:41.243872 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:41.243942 (+ 70us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:41.244109 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:41.244286 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 20:32:41.244467 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":526,"threads_started":1}
I20260806 20:32:41.247470 29231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:41.376775 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 29024
I20260806 20:32:41.419765 29462 heartbeater.cc:503] Master 127.13.149.126:37737 was elected leader, sending a full tablet report...
I20260806 20:32:41.427963 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 29251
I20260806 20:32:41.440598 29700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:41.429303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.13.149.66:36201)
0806 20:32:41.430272 (+ 969us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:41.430291 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:41.430337 (+ 46us) server_negotiation.cc:407] Connection header received
0806 20:32:41.430454 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:41.430478 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:41.430891 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:41.431133 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:41.431701 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.433577 (+ 1876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.435592 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.436614 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.436774 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:41.438507 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:41.438526 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:41.438550 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:41.439495 (+ 945us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:41.439564 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:41.439596 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:41.439800 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:41.439973 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 20:32:41.440151 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":450,"threads_started":1}
I20260806 20:32:41.442788 29449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:41.566022 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 29251
I20260806 20:32:41.608625 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 29467
I20260806 20:32:41.623530 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:41.610244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35440 (local address 127.13.149.67:36835)
0806 20:32:41.611220 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:41.611231 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:41.611272 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:32:41.611362 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:41.611372 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:41.611774 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:41.612094 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:41.612987 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.614706 (+ 1719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.617130 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:41.618304 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:41.618573 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:41.620549 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:41.620562 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:41.620586 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:41.621898 (+ 1312us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:41.621988 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:41.622030 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:41.622307 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:41.622605 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 20:32:41.622852 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":422,"threads_started":1}
I20260806 20:32:41.625929 29674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:41.760914 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 29467
I20260806 20:32:41.809716 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 28876
I20260806 20:32:41.811846 28971 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:41.960078 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 28876
2026-08-06T20:32:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (3516 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T20:32:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:32:42Z Disabled control of system clock
I20260806 20:32:42.101583 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42579
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:42091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:42579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 20:32:42.467165 29716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:42.467453 29716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:42.467538 29716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:42.475277 29716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:42.475390 29716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:42.475455 29716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:42.475569 29716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:42.475648 29716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:42.485097 29716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:42091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:42579
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:42.486469 29716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:42.488292 29716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:42.501173 29726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:42.501132 29727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:42.501217 29730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:42.507328 29716 server_base.cc:1034] running on GCE node
I20260806 20:32:42.508216 29716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:42.509737 29716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:42.510951 29716 hybrid_clock.cc:648] HybridClock initialized: now 1786048362510918 us; error 36 us; skew 500 ppm
I20260806 20:32:42.511292 29716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:42.513610 29716 webserver.cc:460] Webserver started at http://127.13.149.126:37823/ using document root <none> and password file <none>
I20260806 20:32:42.514292 29716 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:42.514381 29716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:42.514662 29716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:42.517668 29716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "a6d3408516f5457497fc4362bf7049f7"
format_stamp: "Formatted at 2026-08-06 20:32:42 on dist-test-slave-2kcd"
server_key: "af00260aa7b992f79e97f332cc9edbf9"
server_key_iv: "15e47ba9ec6e5a7504149faa233916b6"
server_key_version: "encryptionkey@0"
I20260806 20:32:42.518445 29716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "a6d3408516f5457497fc4362bf7049f7"
format_stamp: "Formatted at 2026-08-06 20:32:42 on dist-test-slave-2kcd"
server_key: "af00260aa7b992f79e97f332cc9edbf9"
server_key_iv: "15e47ba9ec6e5a7504149faa233916b6"
server_key_version: "encryptionkey@0"
I20260806 20:32:42.524129 29716 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 20:32:42.527606 29741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:42.529145 29716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:32:42.529292 29716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "a6d3408516f5457497fc4362bf7049f7"
format_stamp: "Formatted at 2026-08-06 20:32:42 on dist-test-slave-2kcd"
server_key: "af00260aa7b992f79e97f332cc9edbf9"
server_key_iv: "15e47ba9ec6e5a7504149faa233916b6"
server_key_version: "encryptionkey@0"
I20260806 20:32:42.529474 29716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:42.535045 29716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:42.535763 29716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:42.536026 29716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:42.554682 29716 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:42579
I20260806 20:32:42.554715 29825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:42579 every 8 connection(s)
I20260806 20:32:42.556043 29716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:32:42.557256 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 29716
I20260806 20:32:42.557516 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:32:42.558166 13909 external_mini_cluster.cc:1428] Setting key 852a0c208d93b8ddb4bdd918e6b4f1d3
I20260806 20:32:42.560521 29826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:42.567893 29829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:42.560278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51424 (local address 127.13.149.126:42579)
0806 20:32:42.561554 (+ 1276us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:42.561569 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:42.561622 (+ 53us) server_negotiation.cc:407] Connection header received
0806 20:32:42.563742 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:42.563769 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:42.564323 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:42.564774 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:42.565842 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:42.565851 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:42.565868 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:42.565891 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:42.565986 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:42.566008 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:42.566245 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:42.566389 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 20:32:42.566658 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":471,"threads_started":1}
I20260806 20:32:42.574085 29826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7: Bootstrap starting.
I20260806 20:32:42.577317 29826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:42.578238 29826 log.cc:824] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:42.580883 29826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7: No bootstrap required, opened a new log
I20260806 20:32:42.587874 29826 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d3408516f5457497fc4362bf7049f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42579 } }
I20260806 20:32:42.588176 29826 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:42.588253 29826 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d3408516f5457497fc4362bf7049f7, State: Initialized, Role: FOLLOWER
I20260806 20:32:42.588862 29826 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d3408516f5457497fc4362bf7049f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42579 } }
I20260806 20:32:42.589061 29826 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:32:42.589159 29826 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:32:42.589284 29826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:42.591506 29826 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d3408516f5457497fc4362bf7049f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42579 } }
I20260806 20:32:42.591921 29826 leader_election.cc:302] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6d3408516f5457497fc4362bf7049f7; no voters:
I20260806 20:32:42.592411 29826 leader_election.cc:288] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:32:42.592562 29833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:42.593379 29833 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [term 1 LEADER]: Becoming Leader. State: Replica: a6d3408516f5457497fc4362bf7049f7, State: Running, Role: LEADER
I20260806 20:32:42.593885 29833 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d3408516f5457497fc4362bf7049f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42579 } }
I20260806 20:32:42.594532 29826 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:42.596709 29837 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6d3408516f5457497fc4362bf7049f7. Latest consensus state: current_term: 1 leader_uuid: "a6d3408516f5457497fc4362bf7049f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d3408516f5457497fc4362bf7049f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42579 } } }
I20260806 20:32:42.597136 29837 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:42.598171 29836 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6d3408516f5457497fc4362bf7049f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d3408516f5457497fc4362bf7049f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42579 } } }
I20260806 20:32:42.598583 29836 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:42.601446 29845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:42.606017 29845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:42.614590 29845 catalog_manager.cc:1347] Generated new cluster ID: 49ad3ee784474649a90177a08602d434
I20260806 20:32:42.614714 29845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:42.634809 29845 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:32:42.635851 29845 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:42.650434 29845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6d3408516f5457497fc4362bf7049f7: Generated new TSK 0
I20260806 20:32:42.651654 29845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:32:42.670624 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42579
--builtin_ntp_servers=127.13.149.84:42091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 20:32:43.043402 29860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:43.043673 29860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:43.043830 29860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:43.051406 29860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:43.051512 29860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:43.051707 29860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:43.060726 29860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:42091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:43.062119 29860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:43.063979 29860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:43.077648 29866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:43.077716 29867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:43.077883 29871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:43.078601 29860 server_base.cc:1034] running on GCE node
I20260806 20:32:43.079198 29860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:43.080144 29860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:43.081372 29860 hybrid_clock.cc:648] HybridClock initialized: now 1786048363081320 us; error 66 us; skew 500 ppm
I20260806 20:32:43.081686 29860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:43.083832 29860 webserver.cc:460] Webserver started at http://127.13.149.65:45813/ using document root <none> and password file <none>
I20260806 20:32:43.084532 29860 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:43.084666 29860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:43.085026 29860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:43.087926 29860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "9320fb3cc3374d6bae20204cdf384f6c"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "3b812434f7e32ad1f73cedae84623529"
server_key_iv: "4bd931d044966bdca9e63c962ae0033d"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.088747 29860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "9320fb3cc3374d6bae20204cdf384f6c"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "3b812434f7e32ad1f73cedae84623529"
server_key_iv: "4bd931d044966bdca9e63c962ae0033d"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.093709 29860 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 20:32:43.097246 29880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:43.098538 29860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:32:43.098711 29860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "9320fb3cc3374d6bae20204cdf384f6c"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "3b812434f7e32ad1f73cedae84623529"
server_key_iv: "4bd931d044966bdca9e63c962ae0033d"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.098984 29860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:43.104523 29860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:43.105288 29860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:43.105515 29860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:43.106336 29860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:43.107741 29860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:43.107827 29860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:43.107913 29860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:43.107967 29860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:43.141786 29860 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:37977
I20260806 20:32:43.141878 30083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:37977 every 8 connection(s)
I20260806 20:32:43.143105 29860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:43.147781 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 29860
I20260806 20:32:43.148005 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:32:43.148661 13909 external_mini_cluster.cc:1428] Setting key 11ab0e1eddc900fbdd16c784ae481f03
I20260806 20:32:43.151785 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:43.145820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:38671 (local address 127.13.149.126:42579)
0806 20:32:43.146302 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:43.146307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:43.147453 (+ 1146us) server_negotiation.cc:407] Connection header received
0806 20:32:43.149316 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:43.149322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:43.149394 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:43.149539 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:43.151098 (+ 1559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:43.151103 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:43.151106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:43.151121 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:43.151163 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:43.151174 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:43.151269 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:43.151524 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 20:32:43.151574 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":243,"threads_started":1}
I20260806 20:32:43.152047 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42579
--builtin_ntp_servers=127.13.149.84:42091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 20:32:43.153084 30091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:43.146417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42579 (local address 127.13.149.65:38671)
0806 20:32:43.147292 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:43.147332 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:43.149053 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:43.149781 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:43.149791 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:43.149944 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:43.150744 (+ 800us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:32:43.150748 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:43.150801 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:32:43.150923 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:43.151282 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:43.151293 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:43.151301 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 20:32:43.151593 (+ 292us) client_negotiation.cc:240] Negotiation successful
0806 20:32:43.151850 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":267,"threads_started":1}
I20260806 20:32:43.154593 30086 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42579
I20260806 20:32:43.154881 30086 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:43.155435 30086 heartbeater.cc:511] Master 127.13.149.126:42579 requested a full tablet report, sending...
I20260806 20:32:43.157420 29762 ts_manager.cc:194] Registered new tserver with Master: 9320fb3cc3374d6bae20204cdf384f6c (127.13.149.65:37977)
W20260806 20:32:43.487289 30092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:43.487571 30092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:43.487661 30092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:43.494596 30092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:43.494685 30092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:43.494796 30092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:43.503796 30092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:42091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:43.505019 30092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:43.506680 30092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:43.519438 30101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:43.519472 30102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:43.519500 30105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:43.520407 30092 server_base.cc:1034] running on GCE node
I20260806 20:32:43.521060 30092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:43.521924 30092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:43.523150 30092 hybrid_clock.cc:648] HybridClock initialized: now 1786048363523110 us; error 50 us; skew 500 ppm
I20260806 20:32:43.523447 30092 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:43.525679 30092 webserver.cc:460] Webserver started at http://127.13.149.66:40917/ using document root <none> and password file <none>
I20260806 20:32:43.526322 30092 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:43.526458 30092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:43.526784 30092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:43.529644 30092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "8fdef34deaf94065b38de8064a07a0d6"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "356818e5f458cf6c7adefe2284227dae"
server_key_iv: "dbee9eaa254465ce0880cf91cb60c07a"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.530464 30092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "8fdef34deaf94065b38de8064a07a0d6"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "356818e5f458cf6c7adefe2284227dae"
server_key_iv: "dbee9eaa254465ce0880cf91cb60c07a"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.535370 30092 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260806 20:32:43.538563 30113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:43.539789 30092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 20:32:43.539955 30092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "8fdef34deaf94065b38de8064a07a0d6"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "356818e5f458cf6c7adefe2284227dae"
server_key_iv: "dbee9eaa254465ce0880cf91cb60c07a"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.540187 30092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:43.545614 30092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:43.546357 30092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:43.546639 30092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:43.547538 30092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:43.549018 30092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:43.549137 30092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:43.549273 30092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:43.549361 30092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:43.585954 30092 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:38247
I20260806 20:32:43.586014 30301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:38247 every 8 connection(s)
I20260806 20:32:43.587273 30092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:43.591053 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 30092
I20260806 20:32:43.591244 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:32:43.591804 13909 external_mini_cluster.cc:1428] Setting key 1f4232cfde72e54650f4d408ae085784
I20260806 20:32:43.595379 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42579
--builtin_ntp_servers=127.13.149.84:42091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 20:32:43.596287 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:43.589889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:60643 (local address 127.13.149.126:42579)
0806 20:32:43.590068 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:43.590073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:43.591524 (+ 1451us) server_negotiation.cc:407] Connection header received
0806 20:32:43.593689 (+ 2165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:43.593695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:43.593782 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:43.593891 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:43.595564 (+ 1673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:43.595572 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:43.595579 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:43.595604 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:43.595654 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:43.595666 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:43.595768 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:43.596055 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 20:32:43.596105 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 20:32:43.597994 30304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:43.590273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42579 (local address 127.13.149.66:60643)
0806 20:32:43.591355 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:43.591406 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:43.593423 (+ 2017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:43.594198 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:43.594210 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:43.594367 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:43.595141 (+ 774us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:32:43.595147 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:43.595204 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:32:43.595335 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:43.595788 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:43.595804 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:43.595816 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 20:32:43.596142 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 20:32:43.596694 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":297,"threads_started":1}
I20260806 20:32:43.600311 30302 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42579
I20260806 20:32:43.600623 30302 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:43.601251 30302 heartbeater.cc:511] Master 127.13.149.126:42579 requested a full tablet report, sending...
I20260806 20:32:43.602675 29762 ts_manager.cc:194] Registered new tserver with Master: 8fdef34deaf94065b38de8064a07a0d6 (127.13.149.66:38247)
W20260806 20:32:43.939440 30305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:43.939807 30305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:43.940056 30305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:43.948310 30305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:43.948431 30305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:43.948642 30305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:43.958225 30305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:42091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:43.959619 30305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:43.961493 30305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:43.974696 30310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:43.974895 30312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:43.975224 30316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:43.976102 30305 server_base.cc:1034] running on GCE node
I20260806 20:32:43.976682 30305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:43.977626 30305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:43.978858 30305 hybrid_clock.cc:648] HybridClock initialized: now 1786048363978818 us; error 51 us; skew 500 ppm
I20260806 20:32:43.979178 30305 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:32:43.981469 30305 webserver.cc:460] Webserver started at http://127.13.149.67:37455/ using document root <none> and password file <none>
I20260806 20:32:43.982173 30305 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:43.982309 30305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:43.982640 30305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:43.985596 30305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "3b14830478fd497e951ef1524c7a4335"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "01b692869285f1d416e291bf5bf26b9f"
server_key_iv: "e4c42d4ed936b7b9f8bd358cb2ccf57d"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.986410 30305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "3b14830478fd497e951ef1524c7a4335"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "01b692869285f1d416e291bf5bf26b9f"
server_key_iv: "e4c42d4ed936b7b9f8bd358cb2ccf57d"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.991623 30305 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:32:43.995208 30326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:43.996577 30305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:32:43.996759 30305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "3b14830478fd497e951ef1524c7a4335"
format_stamp: "Formatted at 2026-08-06 20:32:43 on dist-test-slave-2kcd"
server_key: "01b692869285f1d416e291bf5bf26b9f"
server_key_iv: "e4c42d4ed936b7b9f8bd358cb2ccf57d"
server_key_version: "encryptionkey@0"
I20260806 20:32:43.997043 30305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:44.002794 30305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:44.003648 30305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:44.003926 30305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:44.004976 30305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:44.006431 30305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:44.006557 30305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:44.006697 30305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:44.006788 30305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:44.040879 30305 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:33557
I20260806 20:32:44.040994 30521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:33557 every 8 connection(s)
I20260806 20:32:44.042325 30305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:44.045423 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 30305
I20260806 20:32:44.045614 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:32:44.046058 13909 external_mini_cluster.cc:1428] Setting key 2b9cb8acb8afdbfe3cc8bb9571d841b5
I20260806 20:32:44.051472 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:44.045204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:45627 (local address 127.13.149.126:42579)
0806 20:32:44.045408 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:44.045413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:44.047151 (+ 1738us) server_negotiation.cc:407] Connection header received
0806 20:32:44.049443 (+ 2292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:44.049448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:44.049512 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:44.049594 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:44.050885 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:44.050888 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:44.050891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:44.050904 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:44.050929 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:44.050939 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:44.051023 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:44.051191 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 20:32:44.051238 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:32:44.052390 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:44.045830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42579 (local address 127.13.149.67:45627)
0806 20:32:44.046958 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:44.047012 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:44.049135 (+ 2123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:44.049788 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:44.049796 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:44.049881 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:44.050623 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:32:44.050625 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:44.050669 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:32:44.050753 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:44.051021 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:44.051029 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:44.051034 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 20:32:44.051239 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 20:32:44.051422 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":359,"threads_started":1}
I20260806 20:32:44.053706 30524 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42579
I20260806 20:32:44.054020 30524 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:44.054605 30524 heartbeater.cc:511] Master 127.13.149.126:42579 requested a full tablet report, sending...
I20260806 20:32:44.055943 29762 ts_manager.cc:194] Registered new tserver with Master: 3b14830478fd497e951ef1524c7a4335 (127.13.149.67:33557)
I20260806 20:32:44.061508 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 20:32:44.068305 30090 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:32:44.066375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.13.149.126:42579)
0806 20:32:44.066667 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:44.066672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:44.067259 (+ 587us) server_negotiation.cc:407] Connection header received
0806 20:32:44.067476 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:44.067480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:44.067531 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:44.067631 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:44.068002 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51440: BlockingRecv error: recv got EOF from 127.0.0.1:51440 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 20:32:44.069619 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 29860
I20260806 20:32:44.073505 30536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:44.070699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51918 (local address 127.13.149.65:37977)
0806 20:32:44.071266 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:44.071273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:44.071341 (+ 68us) server_negotiation.cc:407] Connection header received
0806 20:32:44.071422 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:44.071431 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:44.071644 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:44.071774 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:44.072655 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:44.072661 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:44.072672 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:44.072683 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:44.072721 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:44.072734 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:44.072914 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:44.073010 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 20:32:44.073162 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":298,"threads_started":1}
I20260806 20:32:44.074749 30077 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:44.156718 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 29860
I20260806 20:32:44.182870 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 30092
I20260806 20:32:44.186587 30540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:44.183872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49852 (local address 127.13.149.66:38247)
0806 20:32:44.184423 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:44.184430 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:44.184456 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:32:44.184520 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:44.184527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:44.184742 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:44.184943 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:44.185866 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:44.185872 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:44.185883 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:44.185900 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:44.185940 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:44.185954 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:44.186071 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:44.186156 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 20:32:44.186280 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":265,"threads_started":1}
I20260806 20:32:44.187827 30296 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:44.273008 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 30092
I20260806 20:32:44.298187 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 30305
I20260806 20:32:44.302560 30544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:44.299252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49582 (local address 127.13.149.67:33557)
0806 20:32:44.300018 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:44.300025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:44.300057 (+ 32us) server_negotiation.cc:407] Connection header received
0806 20:32:44.300120 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:44.300125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:44.300357 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:44.300538 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:44.301787 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:44.301793 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:44.301804 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:32:44.301822 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:44.301862 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:32:44.301876 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:44.302032 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:44.302086 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 20:32:44.302202 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":399,"threads_started":1}
I20260806 20:32:44.303802 30514 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:44.385222 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 30305
I20260806 20:32:44.409725 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 29716
I20260806 20:32:44.410979 29819 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:44.512619 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 29716
2026-08-06T20:32:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2534 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:32:44 dist-test-slave-2kcd krb5kdc[30550](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:32:44 dist-test-slave-2kcd krb5kdc[30550](info): set up 2 sockets
Aug 06 20:32:44 dist-test-slave-2kcd krb5kdc[30550](info): commencing operation
krb5kdc: starting...
W20260806 20:32:45.860740 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:32:46 dist-test-slave-2kcd krb5kdc[30550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:32:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:32:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:32:46.150313 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:34999
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:34999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:46.497291 30568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:46.497661 30568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:46.497831 30568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:46.505298 30568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:32:46.505467 30568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:46.505587 30568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:46.505697 30568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:32:46.505774 30568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:32:46.516112 30568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:34999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:34999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:46.517637 30568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:46.518939 30568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:46.531015 30578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:46.531055 30580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:46.531227 30575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:46.531800 30568 server_base.cc:1034] running on GCE node
I20260806 20:32:46.532557 30568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:46.534030 30568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:46.535284 30568 hybrid_clock.cc:648] HybridClock initialized: now 1786048366535241 us; error 54 us; skew 500 ppm
I20260806 20:32:46.535815 30568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:46 dist-test-slave-2kcd krb5kdc[30550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048366, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:46.539065 30568 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:32:46.540508 30568 webserver.cc:460] Webserver started at http://127.13.149.126:33009/ using document root <none> and password file <none>
I20260806 20:32:46.541251 30568 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:46.541405 30568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:46.541719 30568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:46.544662 30568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "a9af9184bf6b445794da5da005862c03"
format_stamp: "Formatted at 2026-08-06 20:32:46 on dist-test-slave-2kcd"
server_key: "55cc7013d030172813348dd7be20e9ad"
server_key_iv: "4ffe67e6cd34594ce415c46209490f59"
server_key_version: "encryptionkey@0"
I20260806 20:32:46.545513 30568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "a9af9184bf6b445794da5da005862c03"
format_stamp: "Formatted at 2026-08-06 20:32:46 on dist-test-slave-2kcd"
server_key: "55cc7013d030172813348dd7be20e9ad"
server_key_iv: "4ffe67e6cd34594ce415c46209490f59"
server_key_version: "encryptionkey@0"
I20260806 20:32:46.550593 30568 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260806 20:32:46.553995 30591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:46.555284 30568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:32:46.555473 30568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "a9af9184bf6b445794da5da005862c03"
format_stamp: "Formatted at 2026-08-06 20:32:46 on dist-test-slave-2kcd"
server_key: "55cc7013d030172813348dd7be20e9ad"
server_key_iv: "4ffe67e6cd34594ce415c46209490f59"
server_key_version: "encryptionkey@0"
I20260806 20:32:46.555689 30568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:46.569235 30568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:46.573316 30568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:46.573611 30568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:46.592840 30568 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:34999
I20260806 20:32:46.592859 30685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:34999 every 8 connection(s)
I20260806 20:32:46.594224 30568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:32:46.597842 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 30568
I20260806 20:32:46.597921 30686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:46.598127 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:32:46.598809 13909 external_mini_cluster.cc:1428] Setting key 7fe65a39fa1a3d02391ea7fd940ac387
I20260806 20:32:46.612174 30686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03: Bootstrap starting.
Aug 06 20:32:46 dist-test-slave-2kcd krb5kdc[30550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:46.615413 30686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:46.616814 30686 log.cc:824] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:46.620198 30686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03: No bootstrap required, opened a new log
I20260806 20:32:46.623716 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:46.600814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36994 (local address 127.13.149.126:34999)
0806 20:32:46.601676 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:46.601690 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:46.601739 (+ 49us) server_negotiation.cc:407] Connection header received
0806 20:32:46.604558 (+ 2819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:46.604586 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:46.605081 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:46.605522 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:46.606859 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:46.608886 (+ 2027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:46.610109 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:46.611112 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:46.611278 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:46.615459 (+ 4181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:46.615472 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:46.615493 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:46.615543 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:46.619310 (+ 3767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:46.619947 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:46.619955 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:46.619962 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:46.620186 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:46.620594 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:46.620598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:46.620601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:46.621348 (+ 747us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:46.621677 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:46.621958 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 20:32:46.622393 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":353,"threads_started":1}
I20260806 20:32:46.628700 30686 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af9184bf6b445794da5da005862c03" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34999 } }
I20260806 20:32:46.629070 30686 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:46.629144 30686 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9af9184bf6b445794da5da005862c03, State: Initialized, Role: FOLLOWER
I20260806 20:32:46.629588 30686 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af9184bf6b445794da5da005862c03" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34999 } }
I20260806 20:32:46.629779 30686 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:32:46.629871 30686 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:32:46.630002 30686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:46.631991 30686 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af9184bf6b445794da5da005862c03" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34999 } }
I20260806 20:32:46.632400 30686 leader_election.cc:302] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9af9184bf6b445794da5da005862c03; no voters:
I20260806 20:32:46.632965 30686 leader_election.cc:288] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:32:46.633113 30694 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:46.633821 30694 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [term 1 LEADER]: Becoming Leader. State: Replica: a9af9184bf6b445794da5da005862c03, State: Running, Role: LEADER
I20260806 20:32:46.634346 30694 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af9184bf6b445794da5da005862c03" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34999 } }
I20260806 20:32:46.635011 30686 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:32:46.637358 30698 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9af9184bf6b445794da5da005862c03. Latest consensus state: current_term: 1 leader_uuid: "a9af9184bf6b445794da5da005862c03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af9184bf6b445794da5da005862c03" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34999 } } }
I20260806 20:32:46.637332 30696 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9af9184bf6b445794da5da005862c03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af9184bf6b445794da5da005862c03" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 34999 } } }
I20260806 20:32:46.637741 30696 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:46.637741 30698 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03 [sys.catalog]: This master's current role is: LEADER
I20260806 20:32:46.640184 30703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:32:46.644619 30703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:32:46.653162 30703 catalog_manager.cc:1347] Generated new cluster ID: 439926986fd94cfead47827983877dad
I20260806 20:32:46.653275 30703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:32:46.677855 30703 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:32:46.679790 30703 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:32:46.700083 30703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03: Generated new TSK 0
I20260806 20:32:46.701201 30703 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:32:46.780011 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34999
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:47.120415 30731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:47.120672 30731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:47.120766 30731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:47.127935 30731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:47.128027 30731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:47.128135 30731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:32:47.137809 30731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:47.138940 30731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:47.140414 30731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:47.153975 30738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:47.154055 30737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:47.154023 30741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:47.155576 30731 server_base.cc:1034] running on GCE node
I20260806 20:32:47.156194 30731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:47.157112 30731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:47.158311 30731 hybrid_clock.cc:648] HybridClock initialized: now 1786048367158274 us; error 28 us; skew 500 ppm
I20260806 20:32:47.158627 30731 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:47 dist-test-slave-2kcd krb5kdc[30550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048367, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:47.161929 30731 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:32:47.163406 30731 webserver.cc:460] Webserver started at http://127.13.149.65:39863/ using document root <none> and password file <none>
I20260806 20:32:47.164075 30731 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:47.164222 30731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:47.164530 30731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:47.167412 30731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "3bc892ee19834bd7a3724d957cb169f7"
format_stamp: "Formatted at 2026-08-06 20:32:47 on dist-test-slave-2kcd"
server_key: "fddebac0a09453956f16d800adb799e2"
server_key_iv: "030a0111006ce7c7712639cea265070a"
server_key_version: "encryptionkey@0"
I20260806 20:32:47.168169 30731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "3bc892ee19834bd7a3724d957cb169f7"
format_stamp: "Formatted at 2026-08-06 20:32:47 on dist-test-slave-2kcd"
server_key: "fddebac0a09453956f16d800adb799e2"
server_key_iv: "030a0111006ce7c7712639cea265070a"
server_key_version: "encryptionkey@0"
I20260806 20:32:47.173168 30731 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:32:47.176636 30749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:47.178030 30731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:32:47.178202 30731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "3bc892ee19834bd7a3724d957cb169f7"
format_stamp: "Formatted at 2026-08-06 20:32:47 on dist-test-slave-2kcd"
server_key: "fddebac0a09453956f16d800adb799e2"
server_key_iv: "030a0111006ce7c7712639cea265070a"
server_key_version: "encryptionkey@0"
I20260806 20:32:47.178406 30731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:47.190156 30731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:47.194362 30731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:47.194670 30731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:47.195580 30731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:47.196975 30731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:47.197077 30731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:47.197228 30731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:47.197302 30731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:47.230638 30731 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:32813
I20260806 20:32:47.230671 30950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:32813 every 8 connection(s)
I20260806 20:32:47.231887 30731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:32:47.238492 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 30731
I20260806 20:32:47.238739 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:32:47.239624 13909 external_mini_cluster.cc:1428] Setting key d7f490ea8abe79bf453cf22a879db3c8
Aug 06 20:32:47 dist-test-slave-2kcd krb5kdc[30550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048367, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:47.254264 30953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:47.234695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:36673 (local address 127.13.149.126:34999)
0806 20:32:47.235242 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:47.235249 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:47.236075 (+ 826us) server_negotiation.cc:407] Connection header received
0806 20:32:47.238127 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:47.238131 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:47.238198 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:47.238300 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:47.240376 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.241579 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.243981 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.244360 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.244456 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:47.248551 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:47.248566 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:47.248570 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:47.248602 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:47.251284 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:47.251981 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:47.251987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:47.251991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:47.252114 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:47.252545 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:47.252551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:47.252555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:47.252863 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:47.253019 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:47.253683 (+ 664us) server_negotiation.cc:299] Negotiation successful
0806 20:32:47.253904 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":302,"threads_started":1}
I20260806 20:32:47.255167 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:47.235224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34999 (local address 127.13.149.65:36673)
0806 20:32:47.235907 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:47.235954 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:47.237814 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:47.238593 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:47.238606 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:47.239369 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:47.240177 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:47.240202 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.241762 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.241768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:47.243807 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:47.243831 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.244585 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.244596 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:47.244926 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:47.245676 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:47.245709 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:47.248325 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:47.251428 (+ 3103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:47.251436 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:47.251450 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:47.251858 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:47.252230 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:47.252235 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:47.252239 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:47.252423 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:47.252989 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:47.252996 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:47.253318 (+ 322us) client_negotiation.cc:769] Sending connection context
0806 20:32:47.253582 (+ 264us) client_negotiation.cc:240] Negotiation successful
0806 20:32:47.254083 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":269,"threads_started":1}
I20260806 20:32:47.256774 30951 heartbeater.cc:347] Connected to a master server at 127.13.149.126:34999
I20260806 20:32:47.257149 30951 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:47.257906 30951 heartbeater.cc:511] Master 127.13.149.126:34999 requested a full tablet report, sending...
I20260806 20:32:47.260222 30622 ts_manager.cc:194] Registered new tserver with Master: 3bc892ee19834bd7a3724d957cb169f7 (127.13.149.65:32813)
I20260806 20:32:47.262604 30622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:36673
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:32:47.303856 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34999
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:47.641371 30958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:47.641669 30958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:47.641839 30958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:47.648695 30958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:47.648860 30958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:47.649108 30958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:32:47.658972 30958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:47.660324 30958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:47.661710 30958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:47.675547 30969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:47.675537 30967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:47.675576 30966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:47.676640 30958 server_base.cc:1034] running on GCE node
I20260806 20:32:47.677278 30958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:47.678202 30958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:47.679450 30958 hybrid_clock.cc:648] HybridClock initialized: now 1786048367679396 us; error 47 us; skew 500 ppm
I20260806 20:32:47.679724 30958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:47 dist-test-slave-2kcd krb5kdc[30550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048367, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:47.682931 30958 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:32:47.684319 30958 webserver.cc:460] Webserver started at http://127.13.149.66:44623/ using document root <none> and password file <none>
I20260806 20:32:47.685076 30958 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:47.685179 30958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:47.685423 30958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:47.688248 30958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "2daca5f2ceb343edb261671fb6fbf878"
format_stamp: "Formatted at 2026-08-06 20:32:47 on dist-test-slave-2kcd"
server_key: "87928bf63648cbf868535c05fdd6fade"
server_key_iv: "ba89f78f1df0835b1f0ccabebb3bc5a1"
server_key_version: "encryptionkey@0"
I20260806 20:32:47.689121 30958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "2daca5f2ceb343edb261671fb6fbf878"
format_stamp: "Formatted at 2026-08-06 20:32:47 on dist-test-slave-2kcd"
server_key: "87928bf63648cbf868535c05fdd6fade"
server_key_iv: "ba89f78f1df0835b1f0ccabebb3bc5a1"
server_key_version: "encryptionkey@0"
I20260806 20:32:47.694177 30958 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 20:32:47.697544 30986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:47.698901 30958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:32:47.699091 30958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "2daca5f2ceb343edb261671fb6fbf878"
format_stamp: "Formatted at 2026-08-06 20:32:47 on dist-test-slave-2kcd"
server_key: "87928bf63648cbf868535c05fdd6fade"
server_key_iv: "ba89f78f1df0835b1f0ccabebb3bc5a1"
server_key_version: "encryptionkey@0"
I20260806 20:32:47.699297 30958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:47.726188 30958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:47.730407 30958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:47.730710 30958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:47.731669 30958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:47.733105 30958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:47.733220 30958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:47.733382 30958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:47.733456 30958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:47.766589 30958 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:34623
I20260806 20:32:47.766638 31162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:34623 every 8 connection(s)
I20260806 20:32:47.767843 30958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:32:47.770094 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 30958
I20260806 20:32:47.770314 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:32:47.770876 13909 external_mini_cluster.cc:1428] Setting key adb8a1dc1c62e1d24279762fd7fcd0f4
Aug 06 20:32:47 dist-test-slave-2kcd krb5kdc[30550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048367, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:47.789444 31168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:47.770469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:59529 (local address 127.13.149.126:34999)
0806 20:32:47.771022 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:47.771030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:47.772155 (+ 1125us) server_negotiation.cc:407] Connection header received
0806 20:32:47.774062 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:47.774067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:47.774168 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:47.774285 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:47.775794 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.776561 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.778163 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.778600 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.778741 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:47.782745 (+ 4004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:47.782751 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:47.782755 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:47.782818 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:47.786078 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:47.786799 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:47.786807 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:47.786814 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:47.786976 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:47.787385 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:47.787392 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:47.787399 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:47.787787 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:47.787950 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:47.788621 (+ 671us) server_negotiation.cc:299] Negotiation successful
0806 20:32:47.788939 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":275,"threads_started":1}
I20260806 20:32:47.790037 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:47.771142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34999 (local address 127.13.149.66:59529)
0806 20:32:47.771971 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:47.772027 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:47.773786 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:47.774547 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:47.774555 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:47.775067 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:47.775620 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:47.775637 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.776735 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.776740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:47.778008 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:47.778025 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:47.778844 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:47.778851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:47.779190 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:47.779910 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:47.779933 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:47.782525 (+ 2592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:47.786219 (+ 3694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:47.786226 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:47.786238 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:47.786658 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:47.787088 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:47.787091 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:47.787093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:47.787265 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:47.787911 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:47.787917 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:47.788223 (+ 306us) client_negotiation.cc:769] Sending connection context
0806 20:32:47.788448 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 20:32:47.788903 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":359,"threads_started":1}
I20260806 20:32:47.791626 31163 heartbeater.cc:347] Connected to a master server at 127.13.149.126:34999
I20260806 20:32:47.791962 31163 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:47.792960 31163 heartbeater.cc:511] Master 127.13.149.126:34999 requested a full tablet report, sending...
I20260806 20:32:47.794611 30622 ts_manager.cc:194] Registered new tserver with Master: 2daca5f2ceb343edb261671fb6fbf878 (127.13.149.66:34623)
I20260806 20:32:47.795432 30622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:59529
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:32:47.839865 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34999
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:32:48.180769 31176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:32:48.181125 31176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:32:48.181293 31176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:32:48.188436 31176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:32:48.188601 31176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:32:48.188812 31176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:32:48.198418 31176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:34999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:32:48.199635 31176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:32:48.201066 31176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:32:48.214212 31185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:48.214401 31189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:32:48.214617 31184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:32:48.215361 31176 server_base.cc:1034] running on GCE node
I20260806 20:32:48.215992 31176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:32:48.216979 31176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:32:48.218214 31176 hybrid_clock.cc:648] HybridClock initialized: now 1786048368218159 us; error 44 us; skew 500 ppm
I20260806 20:32:48.218518 31176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:32:48 dist-test-slave-2kcd krb5kdc[30550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048368, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:32:48.221599 31176 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:32:48.222981 31176 webserver.cc:460] Webserver started at http://127.13.149.67:36241/ using document root <none> and password file <none>
I20260806 20:32:48.223659 31176 fs_manager.cc:359] Metadata directory not provided
I20260806 20:32:48.223815 31176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:32:48.224143 31176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:32:48.227093 31176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "654d3da5017e41ad979ca7e9c5b104d4"
format_stamp: "Formatted at 2026-08-06 20:32:48 on dist-test-slave-2kcd"
server_key: "88c6299e25cc9efbfbdc081f86839ac4"
server_key_iv: "4621c94e840a422c4c4d4f8f08b1a263"
server_key_version: "encryptionkey@0"
I20260806 20:32:48.227847 31176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "654d3da5017e41ad979ca7e9c5b104d4"
format_stamp: "Formatted at 2026-08-06 20:32:48 on dist-test-slave-2kcd"
server_key: "88c6299e25cc9efbfbdc081f86839ac4"
server_key_iv: "4621c94e840a422c4c4d4f8f08b1a263"
server_key_version: "encryptionkey@0"
I20260806 20:32:48.233146 31176 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260806 20:32:48.236847 31200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:48.238121 31176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:32:48.238298 31176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "654d3da5017e41ad979ca7e9c5b104d4"
format_stamp: "Formatted at 2026-08-06 20:32:48 on dist-test-slave-2kcd"
server_key: "88c6299e25cc9efbfbdc081f86839ac4"
server_key_iv: "4621c94e840a422c4c4d4f8f08b1a263"
server_key_version: "encryptionkey@0"
I20260806 20:32:48.238503 31176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:32:48.265504 30951 heartbeater.cc:503] Master 127.13.149.126:34999 was elected leader, sending a full tablet report...
I20260806 20:32:48.267650 31176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:32:48.271924 31176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:32:48.272238 31176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:32:48.273243 31176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:32:48.274534 31176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:32:48.274608 31176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:48.274782 31176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:32:48.274839 31176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:32:48.308213 31176 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:33979
I20260806 20:32:48.308250 31399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:33979 every 8 connection(s)
I20260806 20:32:48.309631 31176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:32:48.316215 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 31176
I20260806 20:32:48.316423 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:32:48.316944 13909 external_mini_cluster.cc:1428] Setting key a2ec03b40fe6b4d1d1f62235aca9b0ee
Aug 06 20:32:48 dist-test-slave-2kcd krb5kdc[30550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048368, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:32:48.329421 31404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.312221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:56905 (local address 127.13.149.126:34999)
0806 20:32:48.312659 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.312663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.313666 (+ 1003us) server_negotiation.cc:407] Connection header received
0806 20:32:48.315512 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.315518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.315606 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.315735 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:48.317455 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.318391 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.319927 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.320324 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.320467 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.323804 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:48.323809 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:48.323812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:48.323842 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:48.326345 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:48.327053 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:48.327058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:48.327064 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:48.327184 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:48.327628 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:48.327633 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:48.327636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:48.327899 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:48.328069 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.328967 (+ 898us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.329131 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":200,"threads_started":1}
I20260806 20:32:48.330281 31406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.312752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:34999 (local address 127.13.149.67:56905)
0806 20:32:48.313507 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:48.313552 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:48.315231 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:48.315964 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:48.315972 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:48.316599 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:32:48.317276 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.317295 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.318550 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.318558 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.319756 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.319772 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.320550 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.320558 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.320841 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.321470 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:32:48.321492 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:32:48.323599 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:32:48.326492 (+ 2893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:48.326500 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:48.326515 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:48.326911 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:48.327305 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:32:48.327310 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:32:48.327313 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:32:48.327496 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:32:48.328046 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:32:48.328054 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:32:48.328436 (+ 382us) client_negotiation.cc:769] Sending connection context
0806 20:32:48.328811 (+ 375us) client_negotiation.cc:240] Negotiation successful
0806 20:32:48.329201 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":283,"threads_started":1}
I20260806 20:32:48.331708 31400 heartbeater.cc:347] Connected to a master server at 127.13.149.126:34999
I20260806 20:32:48.331979 31400 heartbeater.cc:464] Registering TS with master...
I20260806 20:32:48.332620 31400 heartbeater.cc:511] Master 127.13.149.126:34999 requested a full tablet report, sending...
I20260806 20:32:48.334106 30622 ts_manager.cc:194] Registered new tserver with Master: 654d3da5017e41ad979ca7e9c5b104d4 (127.13.149.67:33979)
I20260806 20:32:48.334995 30622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:56905
I20260806 20:32:48.345963 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:32:48.363319 31404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.350513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37004 (local address 127.13.149.126:34999)
0806 20:32:48.350695 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.350703 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.351124 (+ 421us) server_negotiation.cc:407] Connection header received
0806 20:32:48.351347 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.351352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.351422 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.351548 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:48.353074 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.353810 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.355096 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.355522 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.355660 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.357943 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:48.357949 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:48.357954 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:48.357995 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:48.360579 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:48.361330 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:48.361336 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:48.361346 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:48.361460 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:48.361858 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:48.361862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:48.361866 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:48.362178 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:48.362466 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.362796 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.363016 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 20:32:48.367134 30622 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:32:48.374032 30622 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:32:48.403565 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.386772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45256 (local address 127.13.149.65:32813)
0806 20:32:48.387423 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.387434 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.387465 (+ 31us) server_negotiation.cc:407] Connection header received
0806 20:32:48.387817 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.387823 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.388013 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.388219 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:48.389089 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.391961 (+ 2872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.398873 (+ 6912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.401107 (+ 2234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.401269 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.401637 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.402926 (+ 1289us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.403137 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":322,"threads_started":1}
I20260806 20:32:48.404608 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.386455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:32813 (local address 127.0.0.1:45256)
0806 20:32:48.387318 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:48.387379 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:48.387576 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:48.388243 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:48.388250 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:48.388281 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:48.388744 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.388759 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.392216 (+ 3457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.392225 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.398608 (+ 6383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.398633 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.402145 (+ 3512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.402151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.402353 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.402690 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 20:32:48.404135 (+ 1445us) client_negotiation.cc:240] Negotiation successful
0806 20:32:48.404339 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":313,"threads_started":1}
I20260806 20:32:48.409099 30837 tablet_service.cc:1467] Processing CreateTablet for tablet c14401dd8c1e4947a56e26d43d471d42 (DEFAULT_TABLE table=test-table [id=aeeadf7f27f247cea13d365a3aa0b2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:48.410720 30837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c14401dd8c1e4947a56e26d43d471d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:48.410951 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.389763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58290 (local address 127.13.149.67:33979)
0806 20:32:48.401919 (+ 12156us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.401926 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.402564 (+ 638us) server_negotiation.cc:407] Connection header received
0806 20:32:48.402715 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.402723 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.403044 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.403245 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:48.404389 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.406007 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.408330 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.409800 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.409941 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.410175 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.410447 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.410612 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12000,"thread_start_us":11825,"threads_started":1}
I20260806 20:32:48.411240 31427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.389619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:33979 (local address 127.0.0.1:58290)
0806 20:32:48.402267 (+ 12648us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:48.402286 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:48.402420 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:48.403361 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:48.403365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:48.403393 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:48.403860 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.403872 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.406143 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.406149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.408172 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.408188 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.410041 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.410048 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.410239 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.410273 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 20:32:48.410402 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 20:32:48.410541 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12538,"spinlock_wait_cycles":12800,"thread_start_us":11775,"threads_started":1}
I20260806 20:32:48.413192 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.387586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:34623 (local address 127.0.0.1:56856)
0806 20:32:48.402224 (+ 14638us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:48.402250 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:48.402420 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:48.403504 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:48.403509 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:48.403539 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:48.404081 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.404095 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.408353 (+ 4258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.408357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.410443 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.410459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.412317 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.412324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.412505 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.412537 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 20:32:48.412641 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 20:32:48.412765 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14476,"spinlock_wait_cycles":4736,"thread_start_us":14190,"threads_started":1}
I20260806 20:32:48.413241 31426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.387887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56856 (local address 127.13.149.66:34623)
0806 20:32:48.388944 (+ 1057us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.388954 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.402417 (+ 13463us) server_negotiation.cc:407] Connection header received
0806 20:32:48.402573 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.402585 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.402932 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.403153 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:48.404268 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.405985 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.410639 (+ 4654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.412070 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.412228 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.412411 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.412711 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.412933 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":680,"threads_started":1}
I20260806 20:32:48.414675 31282 tablet_service.cc:1467] Processing CreateTablet for tablet c14401dd8c1e4947a56e26d43d471d42 (DEFAULT_TABLE table=test-table [id=aeeadf7f27f247cea13d365a3aa0b2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:48.415953 31282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c14401dd8c1e4947a56e26d43d471d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:48.418756 31054 tablet_service.cc:1467] Processing CreateTablet for tablet c14401dd8c1e4947a56e26d43d471d42 (DEFAULT_TABLE table=test-table [id=aeeadf7f27f247cea13d365a3aa0b2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:32:48.420131 31054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c14401dd8c1e4947a56e26d43d471d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:32:48.426484 31431 tablet_bootstrap.cc:492] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Bootstrap starting.
I20260806 20:32:48.431326 31431 tablet_bootstrap.cc:654] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:48.432279 31432 tablet_bootstrap.cc:492] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Bootstrap starting.
I20260806 20:32:48.432737 31431 log.cc:824] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:48.434257 31433 tablet_bootstrap.cc:492] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Bootstrap starting.
I20260806 20:32:48.436187 31431 tablet_bootstrap.cc:492] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: No bootstrap required, opened a new log
I20260806 20:32:48.436475 31431 ts_tablet_manager.cc:1397] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260806 20:32:48.436573 31432 tablet_bootstrap.cc:654] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:48.437670 31432 log.cc:824] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:48.438320 31433 tablet_bootstrap.cc:654] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Neither blocks nor log segments found. Creating new log.
I20260806 20:32:48.439563 31433 log.cc:824] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Log is configured to *not* fsync() on all Append() calls
I20260806 20:32:48.440820 31432 tablet_bootstrap.cc:492] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: No bootstrap required, opened a new log
I20260806 20:32:48.441085 31432 ts_tablet_manager.cc:1397] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260806 20:32:48.442590 31433 tablet_bootstrap.cc:492] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: No bootstrap required, opened a new log
I20260806 20:32:48.442838 31433 ts_tablet_manager.cc:1397] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 20:32:48.447606 31431 raft_consensus.cc:348] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.448081 31431 raft_consensus.cc:374] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:48.448185 31431 raft_consensus.cc:729] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bc892ee19834bd7a3724d957cb169f7, State: Initialized, Role: FOLLOWER
I20260806 20:32:48.448906 31431 consensus_queue.cc:260] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.449282 31432 raft_consensus.cc:348] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.449700 31432 raft_consensus.cc:374] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:48.449805 31432 raft_consensus.cc:729] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 654d3da5017e41ad979ca7e9c5b104d4, State: Initialized, Role: FOLLOWER
I20260806 20:32:48.450320 31432 consensus_queue.cc:260] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.451478 31400 heartbeater.cc:503] Master 127.13.149.126:34999 was elected leader, sending a full tablet report...
I20260806 20:32:48.452201 31432 ts_tablet_manager.cc:1428] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Time spent starting tablet: real 0.011s user 0.008s sys 0.002s
I20260806 20:32:48.453809 31431 ts_tablet_manager.cc:1428] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Time spent starting tablet: real 0.017s user 0.014s sys 0.005s
I20260806 20:32:48.455032 31433 raft_consensus.cc:348] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.455494 31433 raft_consensus.cc:374] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:32:48.455605 31433 raft_consensus.cc:729] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2daca5f2ceb343edb261671fb6fbf878, State: Initialized, Role: FOLLOWER
I20260806 20:32:48.456207 31433 consensus_queue.cc:260] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.457371 31163 heartbeater.cc:503] Master 127.13.149.126:34999 was elected leader, sending a full tablet report...
I20260806 20:32:48.457998 31433 ts_tablet_manager.cc:1428] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260806 20:32:48.484316 30952 tablet.cc:2369] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:32:48.520098 31164 tablet.cc:2369] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:32:48.561336 31403 tablet.cc:2369] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:32:48.771303 31441 raft_consensus.cc:482] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:32:48.771622 31441 raft_consensus.cc:504] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.773703 31441 leader_election.cc:288] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2daca5f2ceb343edb261671fb6fbf878 (127.13.149.66:34623), 654d3da5017e41ad979ca7e9c5b104d4 (127.13.149.67:33979)
I20260806 20:32:48.781765 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.774212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:42447 (local address 127.13.149.67:33979)
0806 20:32:48.774483 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.774489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.775641 (+ 1152us) server_negotiation.cc:407] Connection header received
0806 20:32:48.775821 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.775827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.775896 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.775953 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:48.776720 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.777709 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.779532 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.780754 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.780945 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.781036 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.781351 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.781501 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260806 20:32:48.781985 31426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.774177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:51627 (local address 127.13.149.66:34623)
0806 20:32:48.774396 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.774405 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.775138 (+ 733us) server_negotiation.cc:407] Connection header received
0806 20:32:48.775487 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.775499 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.775567 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.775689 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:32:48.776270 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.777374 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.779799 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.781067 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.781191 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.781288 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.781629 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.781737 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 20:32:48.782420 31445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.774682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:33979 (local address 127.13.149.65:42447)
0806 20:32:48.775507 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:48.775524 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:48.775662 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:48.776141 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:48.776145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:48.776168 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:48.776522 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.776534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.777864 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.777869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.779353 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.779366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.780976 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.780980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.781092 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.781117 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 20:32:48.781914 (+ 797us) client_negotiation.cc:240] Negotiation successful
0806 20:32:48.782064 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":529,"threads_started":1}
I20260806 20:32:48.782526 31444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.774223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:34623 (local address 127.13.149.65:51627)
0806 20:32:48.775001 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0806 20:32:48.775038 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:32:48.775278 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:32:48.775737 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:32:48.775744 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:32:48.775770 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:32:48.776112 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.776121 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.777532 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.777538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.779627 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:32:48.779642 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.781288 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.781297 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:32:48.781477 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.781507 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 20:32:48.781602 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 20:32:48.781725 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":1,"thread_start_us":710,"threads_started":1}
I20260806 20:32:48.783453 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14401dd8c1e4947a56e26d43d471d42" candidate_uuid: "3bc892ee19834bd7a3724d957cb169f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "654d3da5017e41ad979ca7e9c5b104d4" is_pre_election: true
I20260806 20:32:48.783449 31095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14401dd8c1e4947a56e26d43d471d42" candidate_uuid: "3bc892ee19834bd7a3724d957cb169f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2daca5f2ceb343edb261671fb6fbf878" is_pre_election: true
I20260806 20:32:48.783931 31311 raft_consensus.cc:2454] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bc892ee19834bd7a3724d957cb169f7 in term 0.
I20260806 20:32:48.783950 31095 raft_consensus.cc:2454] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bc892ee19834bd7a3724d957cb169f7 in term 0.
I20260806 20:32:48.784570 30750 leader_election.cc:302] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bc892ee19834bd7a3724d957cb169f7, 654d3da5017e41ad979ca7e9c5b104d4; no voters:
I20260806 20:32:48.785048 31441 raft_consensus.cc:2781] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:32:48.785210 31441 raft_consensus.cc:482] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:32:48.785326 31441 raft_consensus.cc:3037] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:48.787513 31441 raft_consensus.cc:504] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.788115 31441 leader_election.cc:288] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2daca5f2ceb343edb261671fb6fbf878 (127.13.149.66:34623), 654d3da5017e41ad979ca7e9c5b104d4 (127.13.149.67:33979)
I20260806 20:32:48.788529 31095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14401dd8c1e4947a56e26d43d471d42" candidate_uuid: "3bc892ee19834bd7a3724d957cb169f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2daca5f2ceb343edb261671fb6fbf878"
I20260806 20:32:48.788627 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c14401dd8c1e4947a56e26d43d471d42" candidate_uuid: "3bc892ee19834bd7a3724d957cb169f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "654d3da5017e41ad979ca7e9c5b104d4"
I20260806 20:32:48.788761 31095 raft_consensus.cc:3037] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:48.788877 31311 raft_consensus.cc:3037] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:32:48.791028 31311 raft_consensus.cc:2454] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bc892ee19834bd7a3724d957cb169f7 in term 1.
I20260806 20:32:48.791034 31095 raft_consensus.cc:2454] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bc892ee19834bd7a3724d957cb169f7 in term 1.
I20260806 20:32:48.791476 30750 leader_election.cc:302] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bc892ee19834bd7a3724d957cb169f7, 654d3da5017e41ad979ca7e9c5b104d4; no voters:
I20260806 20:32:48.791776 31441 raft_consensus.cc:2781] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:32:48.792163 31441 raft_consensus.cc:686] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 1 LEADER]: Becoming Leader. State: Replica: 3bc892ee19834bd7a3724d957cb169f7, State: Running, Role: LEADER
I20260806 20:32:48.792735 31441 consensus_queue.cc:237] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } }
I20260806 20:32:48.797387 30622 catalog_manager.cc:5495] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bc892ee19834bd7a3724d957cb169f7 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "3bc892ee19834bd7a3724d957cb169f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bc892ee19834bd7a3724d957cb169f7" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260806 20:32:48.851297 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.845597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45262 (local address 127.13.149.65:32813)
0806 20:32:48.845838 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.845845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.845942 (+ 97us) server_negotiation.cc:407] Connection header received
0806 20:32:48.846213 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.846218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.846310 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.846479 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:32:48.846873 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.847610 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.849048 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.849465 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.849622 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.850135 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:32:48.850679 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:32:48.850869 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.850928 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.851022 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:32:48.859730 31095 raft_consensus.cc:1261] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 1 FOLLOWER]: Refusing update from remote peer 3bc892ee19834bd7a3724d957cb169f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:48.859756 31311 raft_consensus.cc:1261] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 1 FOLLOWER]: Refusing update from remote peer 3bc892ee19834bd7a3724d957cb169f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:32:48.860877 31447 consensus_queue.cc:1035] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2daca5f2ceb343edb261671fb6fbf878" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:48.861335 31441 consensus_queue.cc:1035] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "654d3da5017e41ad979ca7e9c5b104d4" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:32:48.888352 30621 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:48.888736 30621 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:32:48.892853 30621 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9af9184bf6b445794da5da005862c03: Sending DeleteTablet for 3 replicas of tablet c14401dd8c1e4947a56e26d43d471d42
I20260806 20:32:48.894129 31282 tablet_service.cc:1514] Processing DeleteTablet for tablet c14401dd8c1e4947a56e26d43d471d42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:48 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:58290
I20260806 20:32:48.894210 31054 tablet_service.cc:1514] Processing DeleteTablet for tablet c14401dd8c1e4947a56e26d43d471d42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:48 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:56856
I20260806 20:32:48.895208 30837 tablet_service.cc:1514] Processing DeleteTablet for tablet c14401dd8c1e4947a56e26d43d471d42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:32:48 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:45256
I20260806 20:32:48.895463 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 30731
I20260806 20:32:48.903353 31472 tablet_replica.cc:330] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: stopping tablet replica
I20260806 20:32:48.904165 31471 tablet_replica.cc:330] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: stopping tablet replica
I20260806 20:32:48.904502 31470 tablet_replica.cc:330] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: stopping tablet replica
I20260806 20:32:48.904639 31471 raft_consensus.cc:2229] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:48.905252 31471 raft_consensus.cc:2258] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:48.905319 31470 raft_consensus.cc:2229] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:32:48.905942 31470 raft_consensus.cc:2258] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:48.905886 31472 raft_consensus.cc:2229] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:32:48.906610 31472 raft_consensus.cc:2258] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:32:48.908411 31470 ts_tablet_manager.cc:1905] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:48.908531 31471 ts_tablet_manager.cc:1905] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 20:32:48 dist-test-slave-2kcd krb5kdc[30550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:32:48.915669 31472 ts_tablet_manager.cc:1905] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:32:48.916139 31470 ts_tablet_manager.cc:1918] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:48.916375 31470 log.cc:1196] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/c14401dd8c1e4947a56e26d43d471d42
I20260806 20:32:48.916405 31471 ts_tablet_manager.cc:1918] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:48.916574 31471 log.cc:1196] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/c14401dd8c1e4947a56e26d43d471d42
I20260806 20:32:48.917155 31471 ts_tablet_manager.cc:1939] T c14401dd8c1e4947a56e26d43d471d42 P 2daca5f2ceb343edb261671fb6fbf878: Deleting consensus metadata
I20260806 20:32:48.917166 31470 ts_tablet_manager.cc:1939] T c14401dd8c1e4947a56e26d43d471d42 P 654d3da5017e41ad979ca7e9c5b104d4: Deleting consensus metadata
I20260806 20:32:48.919128 30596 catalog_manager.cc:4841] TS 2daca5f2ceb343edb261671fb6fbf878 (127.13.149.66:34623): tablet c14401dd8c1e4947a56e26d43d471d42 (table test-table [id=aeeadf7f27f247cea13d365a3aa0b2a6]) successfully deleted
I20260806 20:32:48.919129 30594 catalog_manager.cc:4841] TS 654d3da5017e41ad979ca7e9c5b104d4 (127.13.149.67:33979): tablet c14401dd8c1e4947a56e26d43d471d42 (table test-table [id=aeeadf7f27f247cea13d365a3aa0b2a6]) successfully deleted
I20260806 20:32:48.922817 31472 ts_tablet_manager.cc:1918] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:32:48.923050 31472 log.cc:1196] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/c14401dd8c1e4947a56e26d43d471d42
I20260806 20:32:48.923682 31472 ts_tablet_manager.cc:1939] T c14401dd8c1e4947a56e26d43d471d42 P 3bc892ee19834bd7a3724d957cb169f7: Deleting consensus metadata
I20260806 20:32:48.925300 30596 catalog_manager.cc:4841] TS 3bc892ee19834bd7a3724d957cb169f7 (127.13.149.65:32813): tablet c14401dd8c1e4947a56e26d43d471d42 (table test-table [id=aeeadf7f27f247cea13d365a3aa0b2a6]) successfully deleted
I20260806 20:32:48.928653 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:48.898535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45266 (local address 127.13.149.65:32813)
0806 20:32:48.899067 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:48.899076 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:48.902713 (+ 3637us) server_negotiation.cc:407] Connection header received
0806 20:32:48.903585 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:48.903591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:48.903685 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:48.903767 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:48.905841 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.907063 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.908981 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:48.909675 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:48.909777 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:48.920863 (+ 11086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:48.920885 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:48.920904 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:48.920982 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:48.925520 (+ 4538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:48.926295 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:48.926306 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:48.926310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:48.926504 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:48.926910 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:48.926915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:48.926919 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:48.927421 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:48.927735 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:48.927960 (+ 225us) server_negotiation.cc:299] Negotiation successful
0806 20:32:48.928219 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356}
I20260806 20:32:48.929456 30943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:49.028908 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 30731
I20260806 20:32:49.055307 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 30958
Aug 06 20:32:49 dist-test-slave-2kcd krb5kdc[30550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:32:49.070453 31426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:49.056234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.13.149.66:34623)
0806 20:32:49.056438 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:49.056447 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:49.056467 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:32:49.056677 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:49.056683 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:49.056769 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:49.056911 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:49.058161 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:49.058892 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:49.060207 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:49.060720 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:49.061030 (+ 310us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:49.065149 (+ 4119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:49.065164 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:49.065179 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:49.065212 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:49.067907 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:49.068528 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:49.068535 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:49.068537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:49.068683 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:49.069079 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:49.069082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:49.069084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:49.069451 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:49.069667 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:49.069912 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 20:32:49.070068 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:32:49.071158 31158 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:49.161922 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 30958
I20260806 20:32:49.185423 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 31176
Aug 06 20:32:49 dist-test-slave-2kcd krb5kdc[30550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:32:49.201176 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:32:49.186385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.13.149.67:33979)
0806 20:32:49.186580 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 20:32:49.186585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:32:49.186604 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:32:49.186675 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:32:49.186679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:32:49.186774 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:32:49.186885 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:32:49.188191 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:49.189081 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:49.190262 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:32:49.190701 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:32:49.190803 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:32:49.195747 (+ 4944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:32:49.195761 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:32:49.195778 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:32:49.195811 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:32:49.198728 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:49.199359 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:49.199365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:49.199368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:49.199520 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:32:49.199833 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:32:49.199837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:32:49.199838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:32:49.200189 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:32:49.200400 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0806 20:32:49.200667 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 20:32:49.200895 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:32:49.201864 31387 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:49.290745 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 31176
I20260806 20:32:49.314670 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 30568
I20260806 20:32:49.315837 30677 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:32:49.426812 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 30568
2026-08-06T20:32:49Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4920 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:32:49 dist-test-slave-2kcd krb5kdc[31484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:32:49 dist-test-slave-2kcd krb5kdc[31484](info): set up 2 sockets
Aug 06 20:32:49 dist-test-slave-2kcd krb5kdc[31484](info): commencing operation
krb5kdc: starting...
W20260806 20:32:50.794046 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:32:50 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:32:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:32:51Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/rangeradmin_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/rangeradmin_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/rangerlookup_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/rangerlookup_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
I20260806 20:32:51.209113 13909 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdNjTCo/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/postgres -l logfile start
2026-08-06 20:32:53.967 UTC [31531] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 20:32:53.967 UTC [31531] LOG: listening on IPv4 address "127.13.149.84", port 44593
2026-08-06 20:32:53.971 UTC [31531] LOG: listening on Unix socket "/tmp/.s.PGSQL.44593"
2026-08-06 20:32:53.998 UTC [31533] LOG: database system was shut down at 2026-08-06 20:32:52 UTC
2026-08-06 20:32:54.002 UTC [31531] LOG: database system is ready to accept connections
I20260806 20:32:55.206249 13909 mini_postgres.cc:96] Postgres bound to 44593
2026-08-06 20:32:55.233 UTC [31550] FATAL: database "slave" does not exist
127.13.149.84:44593 - accepting connections
I20260806 20:32:55.234284 13909 mini_ranger.cc:161] Starting Ranger...
I20260806 20:32:55.268098 13909 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 20:32:55.760634 13909 mini_ranger.cc:87] Created ranger Postgres database
I20260806 20:32:55.760757 13909 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-admin
2026-08-06 20:32:56,251 [I] DB FLAVOR :POSTGRES
2026-08-06 20:32:56,252 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 20:32:56,252 [I] Checking connection..
2026-08-06 20:32:56,252 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 20:32:56,559 [I] Checking connection passed.
2026-08-06 20:32:56,560 [I] --------- Verifying version history table ---------
2026-08-06 20:32:56,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 20:32:56,831 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 20:32:56,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 20:32:57,095 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 20:32:57,095 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 20:32:57,096 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 20:32:57.366 UTC [31653] WARNING: there is no transaction in progress
2026-08-06 20:32:57,376 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 20:32:57,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 20:32:57,652 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 20:32:57,652 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 20:32:57,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 20:32:57,920 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 20:32:58,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2kcd.c.gcp-upstream.internal','N') ;"
2026-08-06 20:32:58,432 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 20:32:58,695 [I] Table x_portal_user does not exist in database ranger
2026-08-06 20:32:58,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 20:32:58,978 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 20:32:58,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 20:32:59,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 20:32:59,503 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 20:32:59,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 20:33:00.457 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.474 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.490 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.505 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.523 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.543 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.600 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.606 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.620 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.629 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.639 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.652 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.660 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.666 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.672 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:00.678 UTC [31831] WARNING: there is no transaction in progress
2026-08-06 20:33:01,297 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 20:33:01,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 20:33:01,559 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 20:33:01,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 20:33:01,827 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 20:33:01,827 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 20:33:02,098 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 20:33:02,098 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 20:33:02,346 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 20:33:02,584 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2kcd.c.gcp-upstream.internal';"
2026-08-06 20:33:02,855 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 20:33:02,855 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 20:33:03,113 [I] DB_PATCHES have already been applied
I20260806 20:33:03.120157 13909 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdNjTCo/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 20:33:03.120252 13909 mini_ranger.cc:193] Using host: 127.13.149.84
I20260806 20:33:03.143545 13909 mini_ranger.cc:227] Ranger admin URL: http://127.13.149.84:37145
Aug 06, 2026 8:33:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 8:33:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 8:33:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 8:33:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 8:33:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 8:33:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 8:33:04 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 20:33:04.587421 13909 mini_ranger.cc:160] Time spent starting Ranger: real 9.353s user 0.008s sys 0.057s
Aug 06, 2026 8:33:24 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 8:33:24 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 8:33:24 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 8:33:24 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 8:33:25 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 20:33:26.335940 13909 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/rangerkms_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/rangerkms_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.149.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.149.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 20:33:26 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048406, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 20:33:26.559262 13909 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 20:33:26.585412 13909 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 20:33:27.370429 13909 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 20:33:27.370615 13909 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms
I20260806 20:33:27.370764 13909 mini_ranger_kms.cc:227] Using postgres at 127.13.149.84:44593
2026-08-06 20:33:27,899 [I] DB FLAVOR :POSTGRES
2026-08-06 20:33:27,899 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 20:33:27,899 [I] Checking connection
2026-08-06 20:33:27,899 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 20:33:28,152 [I] connection success
2026-08-06 20:33:28,152 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 20:33:28,152 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 20:33:28,152 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 20:33:28,388 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 20:33:28,388 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 20:33:28,388 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 20:33:28,388 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:44593/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 20:33:28,643 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 20:33:29.081130 13909 mini_ranger_kms.cc:310] Created kms service
I20260806 20:33:29.275604 13909 mini_ranger_kms.cc:326] Created kudu user
I20260806 20:33:29.324190 13909 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 20:33:29 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048406, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:33:29.726491 13909 mini_ranger_kms.cc:384] Added ranger policy
I20260806 20:33:29.726852 13909 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 20:33:29.726931 13909 mini_ranger_kms.cc:240] Using host: 127.13.149.84
I20260806 20:33:29.759987 13909 mini_ranger_kms.cc:276] Ranger KMS PID: 32135
I20260806 20:33:29.760198 13909 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.149.84:45991
Aug 06, 2026 8:33:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 8:33:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 8:33:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 8:33:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 8:33:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 8:33:31 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 20:33:32 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786048412, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.149.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:33:32.594771 13909 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.036s user 0.152s sys 0.401s
I20260806 20:33:32.595145 13909 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 20:33:32.595351 13909 mini_ranger_kms.cc:401] 127.13.149.84:45991/kms/v1/keys
Aug 06 20:33:32 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048412, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.149.84@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
Aug 06 20:33:33 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048412, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.149.84@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
Aug 06 20:33:35 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:33:35.488588 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:37345
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:37345
--ranger_config_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:45991/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:33:35.854302 32213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:33:35.854684 32213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:33:35.854851 32213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:33:35.862491 32213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:33:35.862670 32213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:33:35.862785 32213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:33:35.862895 32213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:33:35.862982 32213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:33:35.874044 32213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.149.84:45991/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:37345
--ranger_config_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:37345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:33:35.875474 32213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:33:35.876911 32213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:33:35.889715 32224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:35.889796 32220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:35.889837 32222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:33:35.890369 32213 server_base.cc:1034] running on GCE node
I20260806 20:33:35.891188 32213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:33:35.892635 32213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:33:35.893849 32213 hybrid_clock.cc:648] HybridClock initialized: now 1786048415893814 us; error 63 us; skew 500 ppm
I20260806 20:33:35.894258 32213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:33:35 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048415, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:33:35.897531 32213 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:33:35.899147 32213 webserver.cc:460] Webserver started at http://127.13.149.126:44295/ using document root <none> and password file <none>
I20260806 20:33:35.899847 32213 fs_manager.cc:359] Metadata directory not provided
I20260806 20:33:35.899998 32213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:33:35.900323 32213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:33:35 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048415, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:33:35.958504 32213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "8b20c393ce724e8d930fc86d13a1e295"
format_stamp: "Formatted at 2026-08-06 20:33:35 on dist-test-slave-2kcd"
server_key: "7c3fb67f2d3bfe7d4bcde8892913bde6"
server_key_iv: "e7dfa0e1ea85f7ccc02b50031fb8207f"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:35.959375 32213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "8b20c393ce724e8d930fc86d13a1e295"
format_stamp: "Formatted at 2026-08-06 20:33:35 on dist-test-slave-2kcd"
server_key: "7c3fb67f2d3bfe7d4bcde8892913bde6"
server_key_iv: "e7dfa0e1ea85f7ccc02b50031fb8207f"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:35.964959 32213 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 20:33:35.986675 32237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:35.988219 32213 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 20:33:35.988407 32213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "8b20c393ce724e8d930fc86d13a1e295"
format_stamp: "Formatted at 2026-08-06 20:33:35 on dist-test-slave-2kcd"
server_key: "7c3fb67f2d3bfe7d4bcde8892913bde6"
server_key_iv: "e7dfa0e1ea85f7ccc02b50031fb8207f"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:35.988678 32213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:33:36.002583 32213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:33:36.006959 32213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:33:36.007277 32213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:33:36.028121 32213 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:37345
I20260806 20:33:36.028131 32316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:37345 every 8 connection(s)
I20260806 20:33:36.029651 32213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:33:36.033747 32318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:33:36.037045 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 32213
I20260806 20:33:36.037258 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:33:36.038080 13909 external_mini_cluster.cc:1428] Setting key 56159c550711d45761e7c2a3033997cc
I20260806 20:33:36.048915 32318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295: Bootstrap starting.
I20260806 20:33:36.054266 32318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295: Neither blocks nor log segments found. Creating new log.
I20260806 20:33:36.055776 32318 log.cc:824] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295: Log is configured to *not* fsync() on all Append() calls
I20260806 20:33:36.058995 32318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295: No bootstrap required, opened a new log
Aug 06 20:33:36 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:33:36.067840 32318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b20c393ce724e8d930fc86d13a1e295" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37345 } }
I20260806 20:33:36.068398 32318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:33:36.068523 32318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b20c393ce724e8d930fc86d13a1e295, State: Initialized, Role: FOLLOWER
I20260806 20:33:36.069284 32318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b20c393ce724e8d930fc86d13a1e295" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37345 } }
I20260806 20:33:36.069587 32318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:33:36.069777 32318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:33:36.069998 32318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:33:36.072575 32318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b20c393ce724e8d930fc86d13a1e295" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37345 } }
I20260806 20:33:36.073104 32318 leader_election.cc:302] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b20c393ce724e8d930fc86d13a1e295; no voters:
I20260806 20:33:36.073810 32318 leader_election.cc:288] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:33:36.073923 32326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:33:36.077836 32326 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [term 1 LEADER]: Becoming Leader. State: Replica: 8b20c393ce724e8d930fc86d13a1e295, State: Running, Role: LEADER
I20260806 20:33:36.078583 32326 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b20c393ce724e8d930fc86d13a1e295" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37345 } }
I20260806 20:33:36.079511 32324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:36.040596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35210 (local address 127.13.149.126:37345)
0806 20:33:36.053414 (+ 12818us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:36.053434 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:36.053901 (+ 467us) server_negotiation.cc:407] Connection header received
0806 20:33:36.056680 (+ 2779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:36.056704 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:36.057154 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:36.057561 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:36.059118 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:36.061201 (+ 2083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:36.063074 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:36.064188 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:36.064367 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:36.069471 (+ 5104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:36.069482 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:36.069500 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:36.069547 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:36.073668 (+ 4121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:36.074572 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:36.074580 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:36.074588 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:36.074776 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:36.075273 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:36.075278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:36.075281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:36.076015 (+ 734us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:36.077314 (+ 1299us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:36.077643 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 20:33:36.078121 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12539,"thread_start_us":12298,"threads_started":1}
I20260806 20:33:36.081236 32326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b20c393ce724e8d930fc86d13a1e295. Latest consensus state: current_term: 1 leader_uuid: "8b20c393ce724e8d930fc86d13a1e295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b20c393ce724e8d930fc86d13a1e295" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37345 } } }
I20260806 20:33:36.081712 32326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [sys.catalog]: This master's current role is: LEADER
I20260806 20:33:36.081976 32329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b20c393ce724e8d930fc86d13a1e295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b20c393ce724e8d930fc86d13a1e295" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37345 } } }
I20260806 20:33:36.083842 32329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [sys.catalog]: This master's current role is: LEADER
I20260806 20:33:36.084072 32318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:33:36.084518 32333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:33:36.090493 32333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:33:36.106977 32318 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 20:33:36.107321 32333 catalog_manager.cc:1347] Generated new cluster ID: a410bc716ee4493a932d0462f6a30bad
I20260806 20:33:36.107438 32333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:33:36.127558 32333 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:33:36.129637 32333 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:33:36.147933 32333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295: Generated new TSK 0
I20260806 20:33:36.149154 32333 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:33:36.922427 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:45991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37345
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:33:37 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786048417, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 20:33:37.397073 32394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:33:37.397387 32394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:33:37.397560 32394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:33:37.406338 32394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:33:37.406486 32394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:33:37.406719 32394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:33:37.418717 32394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.149.84:45991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:33:37.420053 32394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:33:37.421512 32394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:33:37.435369 32408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:37.437378 32410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:37.437628 32407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:33:37.438162 32394 server_base.cc:1034] running on GCE node
I20260806 20:33:37.438876 32394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:33:37.439988 32394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:33:37.441215 32394 hybrid_clock.cc:648] HybridClock initialized: now 1786048417441128 us; error 80 us; skew 500 ppm
I20260806 20:33:37.441560 32394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:33:37 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048417, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:33:37.445007 32394 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:33:37.446831 32394 webserver.cc:460] Webserver started at http://127.13.149.65:40277/ using document root <none> and password file <none>
I20260806 20:33:37.447551 32394 fs_manager.cc:359] Metadata directory not provided
I20260806 20:33:37.447698 32394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:33:37.448046 32394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:33:37 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048417, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:33:37.467756 32394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "47dc2ded30b14c7a8a8fdb68356c1f57"
format_stamp: "Formatted at 2026-08-06 20:33:37 on dist-test-slave-2kcd"
server_key: "d5f6b93f1fc8e007c5757093a9d50c2c"
server_key_iv: "4074b6be2df9bbed1913c24280cee7b7"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:37.469293 32394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "47dc2ded30b14c7a8a8fdb68356c1f57"
format_stamp: "Formatted at 2026-08-06 20:33:37 on dist-test-slave-2kcd"
server_key: "d5f6b93f1fc8e007c5757093a9d50c2c"
server_key_iv: "4074b6be2df9bbed1913c24280cee7b7"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:37.476970 32394 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260806 20:33:37.502020 32422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:37.505774 32394 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.007s sys 0.000s
I20260806 20:33:37.506013 32394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "47dc2ded30b14c7a8a8fdb68356c1f57"
format_stamp: "Formatted at 2026-08-06 20:33:37 on dist-test-slave-2kcd"
server_key: "d5f6b93f1fc8e007c5757093a9d50c2c"
server_key_iv: "4074b6be2df9bbed1913c24280cee7b7"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:37.506278 32394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:33:37.524621 32394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:33:37.530019 32394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:33:37.530447 32394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:33:37.543694 32394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:33:37.545951 32394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:33:37.546118 32394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 20:33:37.546321 32394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:33:37.546396 32394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:37.635244 32394 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:41843
I20260806 20:33:37.635264 32599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:41843 every 8 connection(s)
I20260806 20:33:37.637251 32394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:33:37.646700 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 32394
I20260806 20:33:37.646939 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:33:37.647915 13909 external_mini_cluster.cc:1428] Setting key ffdc931535e2ca2def5f5ab983ff2606
Aug 06 20:33:37 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048417, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:33:37.671376 32602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:37.640950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:39427 (local address 127.13.149.126:37345)
0806 20:33:37.644492 (+ 3542us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:37.644499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:37.649159 (+ 4660us) server_negotiation.cc:407] Connection header received
0806 20:33:37.650504 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:37.650510 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:37.650610 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:37.650720 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:37.653140 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:37.654438 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:37.657159 (+ 2721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:37.657883 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:37.657988 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:37.663055 (+ 5067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:37.663065 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:37.663070 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:37.663115 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:37.667189 (+ 4074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:37.668276 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:37.668281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:37.668284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:37.668442 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:37.669077 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:37.669082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:37.669086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:37.669455 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:37.669593 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:37.670641 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0806 20:33:37.670895 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3392,"thread_start_us":3271,"threads_started":1}
I20260806 20:33:37.674077 32603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:37.641831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:37345 (local address 127.13.149.65:39427)
0806 20:33:37.646294 (+ 4463us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:37.646353 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:37.650066 (+ 3713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:37.651184 (+ 1118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:37.651197 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:37.651923 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:33:37.652854 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:37.652883 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:37.654663 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:37.654669 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:37.656970 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:37.656986 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:37.658397 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:37.658405 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:37.658718 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:37.659640 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:33:37.659685 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:33:37.662741 (+ 3056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:33:37.667392 (+ 4651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:33:37.667401 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:33:37.667420 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:33:37.668118 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:33:37.668610 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:33:37.668614 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:33:37.668618 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:33:37.668915 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:33:37.669698 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:33:37.669707 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:33:37.670172 (+ 465us) client_negotiation.cc:769] Sending connection context
0806 20:33:37.671952 (+ 1780us) client_negotiation.cc:240] Negotiation successful
0806 20:33:37.672533 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4117,"thread_start_us":6840,"threads_started":1}
I20260806 20:33:37.676493 32600 heartbeater.cc:347] Connected to a master server at 127.13.149.126:37345
I20260806 20:33:37.676870 32600 heartbeater.cc:464] Registering TS with master...
I20260806 20:33:37.677815 32600 heartbeater.cc:511] Master 127.13.149.126:37345 requested a full tablet report, sending...
I20260806 20:33:37.680732 32266 ts_manager.cc:194] Registered new tserver with Master: 47dc2ded30b14c7a8a8fdb68356c1f57 (127.13.149.65:41843)
I20260806 20:33:37.682837 32266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:39427
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Aug 06 20:33:37 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048417, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:33:37.731880 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:45991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37345
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:33:38 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048417, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
W20260806 20:33:38.219770 32606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:33:38.220314 32606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:33:38.220556 32606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:33:38.232941 32606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:33:38.233137 32606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:33:38.233355 32606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:33:38.248994 32606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.149.84:45991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:33:38.251003 32606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:33:38.253078 32606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:33:38.277978 32619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:38.286841 32621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:38.297590 32624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:33:38.298106 32606 server_base.cc:1034] running on GCE node
I20260806 20:33:38.299525 32606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:33:38.306289 32606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:33:38.307848 32606 hybrid_clock.cc:648] HybridClock initialized: now 1786048418307728 us; error 127 us; skew 500 ppm
I20260806 20:33:38.308391 32606 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:33:38 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048418, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:33:38.316985 32606 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:33:38.322432 32606 webserver.cc:460] Webserver started at http://127.13.149.66:37139/ using document root <none> and password file <none>
I20260806 20:33:38.323243 32606 fs_manager.cc:359] Metadata directory not provided
I20260806 20:33:38.323395 32606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:33:38.323815 32606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:33:38 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048418, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:33:38.348771 32606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "eaeb791c82f446519769534f05958061"
format_stamp: "Formatted at 2026-08-06 20:33:38 on dist-test-slave-2kcd"
server_key: "34dcdf3e2fd46d77c1a18b5e336b71aa"
server_key_iv: "02243841190063edeb3c305c6b7f8aa4"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:38.350232 32606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "eaeb791c82f446519769534f05958061"
format_stamp: "Formatted at 2026-08-06 20:33:38 on dist-test-slave-2kcd"
server_key: "34dcdf3e2fd46d77c1a18b5e336b71aa"
server_key_iv: "02243841190063edeb3c305c6b7f8aa4"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:38.366158 32606 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.009s sys 0.005s
I20260806 20:33:38.388378 32644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:38.390460 32606 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 20:33:38.390712 32606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "eaeb791c82f446519769534f05958061"
format_stamp: "Formatted at 2026-08-06 20:33:38 on dist-test-slave-2kcd"
server_key: "34dcdf3e2fd46d77c1a18b5e336b71aa"
server_key_iv: "02243841190063edeb3c305c6b7f8aa4"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:38.390988 32606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:33:38.415663 32606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:33:38.420817 32606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:33:38.421190 32606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:33:38.422402 32606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:33:38.424202 32606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:33:38.424302 32606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:38.424435 32606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:33:38.424561 32606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 20:33:38.462000 32606 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:39037
I20260806 20:33:38.462007 342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:39037 every 8 connection(s)
I20260806 20:33:38.463663 32606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:33:38.465562 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 32606
I20260806 20:33:38.465759 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:33:38.466245 13909 external_mini_cluster.cc:1428] Setting key 1ef6f51405fe475deb8ba17419415b80
Aug 06 20:33:38 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048418, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:33:38.493592 347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:38.467801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:53991 (local address 127.13.149.126:37345)
0806 20:33:38.469239 (+ 1438us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:38.469247 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:38.472875 (+ 3628us) server_negotiation.cc:407] Connection header received
0806 20:33:38.473340 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:38.473346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:38.473428 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:38.473554 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:38.475641 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:38.476765 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:38.479207 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:38.479826 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:38.479943 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:38.484827 (+ 4884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:38.484837 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:38.484845 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:38.484895 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:38.489041 (+ 4146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:38.490174 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:38.490183 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:38.490189 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:38.490362 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:38.490956 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:38.490965 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:38.490971 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:38.491426 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:38.491587 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:38.492536 (+ 949us) server_negotiation.cc:299] Negotiation successful
0806 20:33:38.492854 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1306,"thread_start_us":1187,"threads_started":1}
I20260806 20:33:38.494504 346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:38.467398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:37345 (local address 127.13.149.66:53991)
0806 20:33:38.470064 (+ 2666us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:38.470118 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:38.473033 (+ 2915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:38.473817 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:38.473831 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:38.474529 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:33:38.475422 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:38.475453 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:38.476989 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:38.476995 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:38.479015 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:38.479031 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:38.480241 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:38.480249 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:38.480555 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:38.481388 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:33:38.481418 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:33:38.484529 (+ 3111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:33:38.489213 (+ 4684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:33:38.489224 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:33:38.489246 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:33:38.490023 (+ 777us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:33:38.490501 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:33:38.490506 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:33:38.490509 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:33:38.490783 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:33:38.491591 (+ 808us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:33:38.491600 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:33:38.492067 (+ 467us) client_negotiation.cc:769] Sending connection context
0806 20:33:38.492395 (+ 328us) client_negotiation.cc:240] Negotiation successful
0806 20:33:38.493017 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2358,"thread_start_us":2137,"threads_started":1}
I20260806 20:33:38.496133 343 heartbeater.cc:347] Connected to a master server at 127.13.149.126:37345
I20260806 20:33:38.496551 343 heartbeater.cc:464] Registering TS with master...
I20260806 20:33:38.497529 343 heartbeater.cc:511] Master 127.13.149.126:37345 requested a full tablet report, sending...
I20260806 20:33:38.499374 32266 ts_manager.cc:194] Registered new tserver with Master: eaeb791c82f446519769534f05958061 (127.13.149.66:39037)
I20260806 20:33:38.500644 32266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:53991
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:33:38.542776 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:45991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37345
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:33:38.686789 32600 heartbeater.cc:503] Master 127.13.149.126:37345 was elected leader, sending a full tablet report...
W20260806 20:33:38.901639 350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:33:38.901911 350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:33:38.902105 350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:33:38.909360 350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:33:38.909516 350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:33:38.909708 350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:33:38.919379 350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.149.84:45991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:37345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:33:38.920645 350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:33:38.921962 350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:33:38.935793 363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:38.935819 357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:33:38.935746 359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:33:38.936223 350 server_base.cc:1034] running on GCE node
I20260806 20:33:38.936983 350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:33:38.937953 350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:33:38.939217 350 hybrid_clock.cc:648] HybridClock initialized: now 1786048418939165 us; error 40 us; skew 500 ppm
I20260806 20:33:38.939541 350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:33:38 dist-test-slave-2kcd krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048418, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:33:38.942639 350 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:33:38.944059 350 webserver.cc:460] Webserver started at http://127.13.149.67:33787/ using document root <none> and password file <none>
I20260806 20:33:38.944765 350 fs_manager.cc:359] Metadata directory not provided
I20260806 20:33:38.944960 350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:33:38.945268 350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:33:38 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048418, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:33:38.960867 350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "330f49b61fb44a06aa4bdb354c233d27"
format_stamp: "Formatted at 2026-08-06 20:33:38 on dist-test-slave-2kcd"
server_key: "c7bd41c3e667b56ed84db68e0074c35c"
server_key_iv: "5f68c73b418102c8400d04d2688e0c6e"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:38.961654 350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "330f49b61fb44a06aa4bdb354c233d27"
format_stamp: "Formatted at 2026-08-06 20:33:38 on dist-test-slave-2kcd"
server_key: "c7bd41c3e667b56ed84db68e0074c35c"
server_key_iv: "5f68c73b418102c8400d04d2688e0c6e"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:38.966785 350 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260806 20:33:38.982009 374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:38.983350 350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:33:38.983484 350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "330f49b61fb44a06aa4bdb354c233d27"
format_stamp: "Formatted at 2026-08-06 20:33:38 on dist-test-slave-2kcd"
server_key: "c7bd41c3e667b56ed84db68e0074c35c"
server_key_iv: "5f68c73b418102c8400d04d2688e0c6e"
server_key_version: "kuduclusterkey@0"
I20260806 20:33:38.983662 350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:33:39.002831 350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:33:39.006198 350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:33:39.006438 350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:33:39.007239 350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:33:39.008463 350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:33:39.008539 350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:39.008646 350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:33:39.008690 350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:33:39.043648 350 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:34047
I20260806 20:33:39.043695 539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:34047 every 8 connection(s)
I20260806 20:33:39.045001 350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:33:39.046342 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 350
I20260806 20:33:39.046562 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:33:39.047077 13909 external_mini_cluster.cc:1428] Setting key ed976be9cc4d9f44f2679ca42a5ee976
Aug 06 20:33:39 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048418, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:33:39.065594 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.048825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:34027 (local address 127.13.149.126:37345)
0806 20:33:39.049549 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.049555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.049577 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:33:39.052075 (+ 2498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.052079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.052154 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.052250 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:39.053747 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.054467 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.056010 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.056430 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.056522 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.059783 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:39.059788 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:39.059791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:39.059820 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:39.062850 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.063617 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.063621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.063623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.063745 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.064126 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.064130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.064132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.064390 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:39.064499 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.065172 (+ 673us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.065336 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":428,"threads_started":1}
I20260806 20:33:39.066557 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.048346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:37345 (local address 127.13.149.67:34027)
0806 20:33:39.049379 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:39.049430 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:39.051803 (+ 2373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:39.052459 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:39.052467 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:39.053020 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:33:39.053587 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.053604 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.054622 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.054625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.055886 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.055898 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.056614 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.056618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.056941 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.057563 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:33:39.057585 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:33:39.059591 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:33:39.062997 (+ 3406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:33:39.063006 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:33:39.063024 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:33:39.063510 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:33:39.063836 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:33:39.063839 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:33:39.063841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:33:39.064030 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:33:39.064491 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:33:39.064497 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:33:39.064849 (+ 352us) client_negotiation.cc:769] Sending connection context
0806 20:33:39.065086 (+ 237us) client_negotiation.cc:240] Negotiation successful
0806 20:33:39.065465 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":423,"threads_started":1}
I20260806 20:33:39.067883 540 heartbeater.cc:347] Connected to a master server at 127.13.149.126:37345
I20260806 20:33:39.068251 540 heartbeater.cc:464] Registering TS with master...
I20260806 20:33:39.069139 540 heartbeater.cc:511] Master 127.13.149.126:37345 requested a full tablet report, sending...
I20260806 20:33:39.070444 32266 ts_manager.cc:194] Registered new tserver with Master: 330f49b61fb44a06aa4bdb354c233d27 (127.13.149.67:34047)
I20260806 20:33:39.071216 32266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:34027
I20260806 20:33:39.074872 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:33:39.092301 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.079643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35224 (local address 127.13.149.126:37345)
0806 20:33:39.079789 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.079793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.080214 (+ 421us) server_negotiation.cc:407] Connection header received
0806 20:33:39.080371 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.080375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.080444 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.080519 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:39.081968 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.082648 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.084097 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.084567 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.084655 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.087060 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:39.087065 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:39.087069 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:39.087096 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:39.089844 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.090500 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.090527 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.090530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.090643 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.090970 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.090973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.090975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.091259 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:39.091454 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.091811 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.091972 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 20:33:39.096575 32266 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:33:39.103760 32266 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:33:39.139297 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.115373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:34047 (local address 127.0.0.1:35742)
0806 20:33:39.127662 (+ 12289us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:39.127708 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:39.127883 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:39.130333 (+ 2450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:39.130345 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:39.130387 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:33:39.130864 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.130880 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.133336 (+ 2456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.133344 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.136376 (+ 3032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.136396 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.138381 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.138388 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.138578 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.138642 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 20:33:39.138784 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 20:33:39.138981 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11992,"thread_start_us":21621,"threads_started":1}
I20260806 20:33:39.140178 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.115631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35742 (local address 127.13.149.67:34047)
0806 20:33:39.126985 (+ 11354us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.126998 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.128273 (+ 1275us) server_negotiation.cc:407] Connection header received
0806 20:33:39.128387 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.128395 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.128651 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.129923 (+ 1272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:33:39.131119 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.133132 (+ 2013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.136603 (+ 3471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.137850 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.138015 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.138232 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.139790 (+ 1558us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.139915 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11092,"thread_start_us":12420,"threads_started":1}
I20260806 20:33:39.144955 447 tablet_service.cc:1467] Processing CreateTablet for tablet 815505cc3b5649cf9fac2e211b45c77c (DEFAULT_TABLE table=test-table [id=0d50f89356584455b9ce98fb74625059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:33:39.146729 447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 815505cc3b5649cf9fac2e211b45c77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:33:39.148305 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.116222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:41843 (local address 127.0.0.1:52808)
0806 20:33:39.139539 (+ 23317us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:39.139555 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:39.139637 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:39.141759 (+ 2122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:39.141764 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:39.141789 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:33:39.141962 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.141973 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.144345 (+ 2372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.144349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.145654 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.145669 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.147530 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.147536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.147724 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.147762 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 20:33:39.147855 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 20:33:39.148002 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23239,"thread_start_us":26376,"threads_started":1}
I20260806 20:33:39.148670 572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.116327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52808 (local address 127.13.149.65:41843)
0806 20:33:39.141231 (+ 24904us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.141239 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.141267 (+ 28us) server_negotiation.cc:407] Connection header received
0806 20:33:39.141371 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.141378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.141587 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.141782 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:33:39.142153 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.144148 (+ 1995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.145837 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.147342 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.147505 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.147736 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.147933 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.148100 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24727,"thread_start_us":24591,"threads_started":1}
I20260806 20:33:39.150089 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.115751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:39037 (local address 127.0.0.1:42858)
0806 20:33:39.136808 (+ 21057us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:39.136827 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:39.136930 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:39.143197 (+ 6267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:39.143202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:39.143231 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:33:39.143782 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.143796 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.145686 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.145692 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.147149 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.147160 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.149322 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.149331 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.149530 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.149561 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 20:33:39.149641 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 20:33:39.149768 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20912,"thread_start_us":11469,"threads_started":1}
I20260806 20:33:39.150813 564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.115838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42858 (local address 127.13.149.66:39037)
0806 20:33:39.142672 (+ 26834us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.142681 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.142707 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:33:39.142793 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.142800 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.143017 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.143200 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:33:39.143991 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.145554 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.147292 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.148833 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.148984 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.150409 (+ 1425us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.150461 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.150585 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26659,"thread_start_us":26550,"threads_started":1}
I20260806 20:33:39.152437 32507 tablet_service.cc:1467] Processing CreateTablet for tablet 815505cc3b5649cf9fac2e211b45c77c (DEFAULT_TABLE table=test-table [id=0d50f89356584455b9ce98fb74625059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:33:39.153518 32723 tablet_service.cc:1467] Processing CreateTablet for tablet 815505cc3b5649cf9fac2e211b45c77c (DEFAULT_TABLE table=test-table [id=0d50f89356584455b9ce98fb74625059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:33:39.154016 32507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 815505cc3b5649cf9fac2e211b45c77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:33:39.154534 32723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 815505cc3b5649cf9fac2e211b45c77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:33:39.162285 573 tablet_bootstrap.cc:492] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Bootstrap starting.
I20260806 20:33:39.165683 573 tablet_bootstrap.cc:654] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Neither blocks nor log segments found. Creating new log.
I20260806 20:33:39.166898 573 log.cc:824] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Log is configured to *not* fsync() on all Append() calls
I20260806 20:33:39.166935 575 tablet_bootstrap.cc:492] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Bootstrap starting.
I20260806 20:33:39.169528 577 tablet_bootstrap.cc:492] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Bootstrap starting.
I20260806 20:33:39.170593 573 tablet_bootstrap.cc:492] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: No bootstrap required, opened a new log
I20260806 20:33:39.170673 575 tablet_bootstrap.cc:654] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Neither blocks nor log segments found. Creating new log.
I20260806 20:33:39.170861 573 ts_tablet_manager.cc:1397] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 20:33:39.171973 575 log.cc:824] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Log is configured to *not* fsync() on all Append() calls
I20260806 20:33:39.173030 577 tablet_bootstrap.cc:654] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Neither blocks nor log segments found. Creating new log.
I20260806 20:33:39.174136 577 log.cc:824] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Log is configured to *not* fsync() on all Append() calls
I20260806 20:33:39.175249 575 tablet_bootstrap.cc:492] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: No bootstrap required, opened a new log
I20260806 20:33:39.176185 575 ts_tablet_manager.cc:1397] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 20:33:39.177315 577 tablet_bootstrap.cc:492] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: No bootstrap required, opened a new log
I20260806 20:33:39.177590 577 ts_tablet_manager.cc:1397] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260806 20:33:39.181572 573 raft_consensus.cc:348] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.182003 573 raft_consensus.cc:374] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:33:39.182111 573 raft_consensus.cc:729] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330f49b61fb44a06aa4bdb354c233d27, State: Initialized, Role: FOLLOWER
I20260806 20:33:39.182721 573 consensus_queue.cc:260] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.184672 577 raft_consensus.cc:348] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.185156 577 raft_consensus.cc:374] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:33:39.185271 577 raft_consensus.cc:729] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47dc2ded30b14c7a8a8fdb68356c1f57, State: Initialized, Role: FOLLOWER
I20260806 20:33:39.185806 577 consensus_queue.cc:260] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.188501 575 raft_consensus.cc:348] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.189069 575 raft_consensus.cc:374] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:33:39.189178 575 raft_consensus.cc:729] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaeb791c82f446519769534f05958061, State: Initialized, Role: FOLLOWER
I20260806 20:33:39.189874 575 consensus_queue.cc:260] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.190888 573 ts_tablet_manager.cc:1428] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Time spent starting tablet: real 0.020s user 0.011s sys 0.008s
I20260806 20:33:39.191131 343 heartbeater.cc:503] Master 127.13.149.126:37345 was elected leader, sending a full tablet report...
I20260806 20:33:39.191242 540 heartbeater.cc:503] Master 127.13.149.126:37345 was elected leader, sending a full tablet report...
I20260806 20:33:39.191620 575 ts_tablet_manager.cc:1428] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260806 20:33:39.193187 577 ts_tablet_manager.cc:1428] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
W20260806 20:33:39.215773 345 tablet.cc:2369] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:33:39.297137 541 tablet.cc:2369] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:33:39.363716 583 raft_consensus.cc:482] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:33:39.364006 583 raft_consensus.cc:504] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.365798 583 leader_election.cc:288] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330f49b61fb44a06aa4bdb354c233d27 (127.13.149.67:34047), eaeb791c82f446519769534f05958061 (127.13.149.66:39037)
I20260806 20:33:39.372565 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.366199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:42417 (local address 127.13.149.67:34047)
0806 20:33:39.366436 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.366443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.367149 (+ 706us) server_negotiation.cc:407] Connection header received
0806 20:33:39.367423 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.367428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.367485 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.367592 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:33:39.368210 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.368997 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.370837 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.371612 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.371799 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.371878 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.372170 (+ 292us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.372296 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 20:33:39.372632 564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.366364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:35833 (local address 127.13.149.66:39037)
0806 20:33:39.366606 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.366614 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.367318 (+ 704us) server_negotiation.cc:407] Connection header received
0806 20:33:39.367487 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.367491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.367553 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.367648 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:33:39.368283 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.369068 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.370881 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.371715 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.371893 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.371976 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.372240 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.372370 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:33:39.372702 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.366200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:34047 (local address 127.13.149.65:42417)
0806 20:33:39.367024 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:39.367047 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:39.367220 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:39.367607 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:39.367611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:39.367635 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:33:39.368054 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.368067 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.369123 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.369131 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.370675 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.370688 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.371834 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.371840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.372008 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.372032 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 20:33:39.372141 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 20:33:39.372268 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":1,"thread_start_us":473,"threads_started":1}
I20260806 20:33:39.372802 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.366425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:39037 (local address 127.13.149.65:35833)
0806 20:33:39.367209 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0806 20:33:39.367223 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:33:39.367328 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:33:39.367661 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:33:39.367666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:33:39.367692 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:33:39.368112 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.368122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.369202 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.369207 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.370734 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:33:39.370746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.371946 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.371953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:33:39.372092 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.372114 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 20:33:39.372214 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:33:39.372333 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":25,"thread_start_us":483,"threads_started":1}
I20260806 20:33:39.373888 474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815505cc3b5649cf9fac2e211b45c77c" candidate_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330f49b61fb44a06aa4bdb354c233d27" is_pre_election: true
I20260806 20:33:39.373883 32747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815505cc3b5649cf9fac2e211b45c77c" candidate_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaeb791c82f446519769534f05958061" is_pre_election: true
I20260806 20:33:39.374369 474 raft_consensus.cc:2454] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47dc2ded30b14c7a8a8fdb68356c1f57 in term 0.
I20260806 20:33:39.374369 32747 raft_consensus.cc:2454] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47dc2ded30b14c7a8a8fdb68356c1f57 in term 0.
I20260806 20:33:39.375030 32423 leader_election.cc:302] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330f49b61fb44a06aa4bdb354c233d27, 47dc2ded30b14c7a8a8fdb68356c1f57; no voters:
I20260806 20:33:39.375425 583 raft_consensus.cc:2781] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:33:39.375569 583 raft_consensus.cc:482] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:33:39.375694 583 raft_consensus.cc:3037] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:33:39.378016 583 raft_consensus.cc:504] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.378629 583 leader_election.cc:288] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [CANDIDATE]: Term 1 election: Requested vote from peers 330f49b61fb44a06aa4bdb354c233d27 (127.13.149.67:34047), eaeb791c82f446519769534f05958061 (127.13.149.66:39037)
I20260806 20:33:39.379056 474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815505cc3b5649cf9fac2e211b45c77c" candidate_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330f49b61fb44a06aa4bdb354c233d27"
I20260806 20:33:39.379086 32747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815505cc3b5649cf9fac2e211b45c77c" candidate_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaeb791c82f446519769534f05958061"
I20260806 20:33:39.379247 474 raft_consensus.cc:3037] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:33:39.379258 32747 raft_consensus.cc:3037] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:33:39.381443 32747 raft_consensus.cc:2454] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47dc2ded30b14c7a8a8fdb68356c1f57 in term 1.
I20260806 20:33:39.381465 474 raft_consensus.cc:2454] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47dc2ded30b14c7a8a8fdb68356c1f57 in term 1.
I20260806 20:33:39.381824 32429 leader_election.cc:302] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47dc2ded30b14c7a8a8fdb68356c1f57, eaeb791c82f446519769534f05958061; no voters:
I20260806 20:33:39.382138 583 raft_consensus.cc:2781] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:33:39.382596 583 raft_consensus.cc:686] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 1 LEADER]: Becoming Leader. State: Replica: 47dc2ded30b14c7a8a8fdb68356c1f57, State: Running, Role: LEADER
I20260806 20:33:39.383036 583 consensus_queue.cc:237] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } }
I20260806 20:33:39.387382 32263 catalog_manager.cc:5495] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47dc2ded30b14c7a8a8fdb68356c1f57 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47dc2ded30b14c7a8a8fdb68356c1f57" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 41843 } health_report { overall_health: HEALTHY } } }
W20260806 20:33:39.396706 32601 tablet.cc:2369] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:33:39.432940 572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.427745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52810 (local address 127.13.149.65:41843)
0806 20:33:39.427975 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.427979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.427999 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:33:39.428156 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.428159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.428241 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.428369 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:33:39.428707 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.429533 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.430905 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.431297 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.431385 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.431837 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:33:39.432358 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:33:39.432472 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.432546 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.432611 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 20:33:39.441524 474 raft_consensus.cc:1261] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 1 FOLLOWER]: Refusing update from remote peer 47dc2ded30b14c7a8a8fdb68356c1f57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:33:39.441515 32747 raft_consensus.cc:1261] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 1 FOLLOWER]: Refusing update from remote peer 47dc2ded30b14c7a8a8fdb68356c1f57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:33:39.442633 589 consensus_queue.cc:1035] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaeb791c82f446519769534f05958061" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:33:39.443003 583 consensus_queue.cc:1035] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330f49b61fb44a06aa4bdb354c233d27" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 34047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:33:39.455322 594 mvcc.cc:205] Tried to move back new op lower bound from 7315654326020968448 to 7315654325796225024. Current Snapshot: MvccSnapshot[applied={T|T < 7315654326020968448}]
I20260806 20:33:39.457662 599 mvcc.cc:205] Tried to move back new op lower bound from 7315654326020968448 to 7315654325796225024. Current Snapshot: MvccSnapshot[applied={T|T < 7315654326020968448}]
I20260806 20:33:39.470371 32263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:33:39.470644 32263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:33:39.474599 32263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b20c393ce724e8d930fc86d13a1e295: Sending DeleteTablet for 3 replicas of tablet 815505cc3b5649cf9fac2e211b45c77c
I20260806 20:33:39.475695 447 tablet_service.cc:1514] Processing DeleteTablet for tablet 815505cc3b5649cf9fac2e211b45c77c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:33:39 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:35742
I20260806 20:33:39.476091 32507 tablet_service.cc:1514] Processing DeleteTablet for tablet 815505cc3b5649cf9fac2e211b45c77c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:33:39 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:52808
I20260806 20:33:39.476347 32723 tablet_service.cc:1514] Processing DeleteTablet for tablet 815505cc3b5649cf9fac2e211b45c77c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:33:39 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:42858
I20260806 20:33:39.477550 614 tablet_replica.cc:330] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: stopping tablet replica
I20260806 20:33:39.477944 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 32394
I20260806 20:33:39.480388 614 raft_consensus.cc:2229] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:33:39.481340 611 tablet_replica.cc:330] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: stopping tablet replica
I20260806 20:33:39.481837 611 raft_consensus.cc:2229] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:33:39.482535 611 raft_consensus.cc:2258] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:33:39.483045 614 raft_consensus.cc:2258] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:33:39.485886 611 ts_tablet_manager.cc:1905] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:33:39.485877 614 ts_tablet_manager.cc:1905] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:33:39.497289 610 tablet_replica.cc:330] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: stopping tablet replica
I20260806 20:33:39.497884 610 raft_consensus.cc:2229] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:33:39.498458 610 raft_consensus.cc:2258] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:33:39.499332 614 ts_tablet_manager.cc:1918] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:33:39.499624 614 log.cc:1196] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/815505cc3b5649cf9fac2e211b45c77c
I20260806 20:33:39.500258 614 ts_tablet_manager.cc:1939] T 815505cc3b5649cf9fac2e211b45c77c P eaeb791c82f446519769534f05958061: Deleting consensus metadata
Aug 06 20:33:39 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:33:39.502370 32243 catalog_manager.cc:4841] TS eaeb791c82f446519769534f05958061 (127.13.149.66:39037): tablet 815505cc3b5649cf9fac2e211b45c77c (table test-table [id=0d50f89356584455b9ce98fb74625059]) successfully deleted
I20260806 20:33:39.504738 611 ts_tablet_manager.cc:1918] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:33:39.504966 611 log.cc:1196] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/815505cc3b5649cf9fac2e211b45c77c
I20260806 20:33:39.505836 610 ts_tablet_manager.cc:1905] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:33:39.509006 611 ts_tablet_manager.cc:1939] T 815505cc3b5649cf9fac2e211b45c77c P 47dc2ded30b14c7a8a8fdb68356c1f57: Deleting consensus metadata
I20260806 20:33:39.511142 32241 catalog_manager.cc:4841] TS 47dc2ded30b14c7a8a8fdb68356c1f57 (127.13.149.65:41843): tablet 815505cc3b5649cf9fac2e211b45c77c (table test-table [id=0d50f89356584455b9ce98fb74625059]) successfully deleted
I20260806 20:33:39.512706 572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.479583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52812 (local address 127.13.149.65:41843)
0806 20:33:39.480046 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.480054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.483791 (+ 3737us) server_negotiation.cc:407] Connection header received
0806 20:33:39.487115 (+ 3324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.487120 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.487196 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.487285 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:39.493426 (+ 6141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.494663 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.496917 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.497603 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.497707 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.504120 (+ 6413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:39.504136 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:39.504158 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:39.504202 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:39.508991 (+ 4789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.510022 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.510032 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.510036 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.510231 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.510739 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.510746 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.510749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.511329 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:39.511655 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.512032 (+ 377us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.512300 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323}
I20260806 20:33:39.513402 32594 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:33:39.513662 610 ts_tablet_manager.cc:1918] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:33:39.513832 610 log.cc:1196] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/815505cc3b5649cf9fac2e211b45c77c
I20260806 20:33:39.514389 610 ts_tablet_manager.cc:1939] T 815505cc3b5649cf9fac2e211b45c77c P 330f49b61fb44a06aa4bdb354c233d27: Deleting consensus metadata
I20260806 20:33:39.516412 32238 catalog_manager.cc:4841] TS 330f49b61fb44a06aa4bdb354c233d27 (127.13.149.67:34047): tablet 815505cc3b5649cf9fac2e211b45c77c (table test-table [id=0d50f89356584455b9ce98fb74625059]) successfully deleted
I20260806 20:33:39.612674 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 32394
I20260806 20:33:39.637979 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 32606
Aug 06 20:33:39 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:33:39.653761 564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.638767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42862 (local address 127.13.149.66:39037)
0806 20:33:39.638990 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.638998 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.639095 (+ 97us) server_negotiation.cc:407] Connection header received
0806 20:33:39.639316 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.639321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.639386 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.639491 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:39.640885 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.641633 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.642998 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.643393 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.643531 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.647919 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:39.647935 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:39.647951 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:39.647987 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:39.650963 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.651677 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.651685 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.651687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.651821 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.652206 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.652211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.652214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.652574 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:39.653031 (+ 457us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.653186 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.653401 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 20:33:39.654479 334 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:33:39.743561 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 32606
I20260806 20:33:39.767685 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 350
Aug 06 20:33:39 dist-test-slave-2kcd krb5kdc[31484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:33:39.783226 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:33:39.768491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35752 (local address 127.13.149.67:34047)
0806 20:33:39.768714 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 20:33:39.768722 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:33:39.768743 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:33:39.768969 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:33:39.768975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:33:39.769064 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:33:39.769171 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:33:39.770598 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.771319 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.772617 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:33:39.773109 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:33:39.773241 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:33:39.777675 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:33:39.777690 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:33:39.777707 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:33:39.777739 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:33:39.780297 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.781054 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.781063 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.781067 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.781200 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:33:39.781614 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:33:39.781619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:33:39.781627 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:33:39.782006 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:33:39.782307 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0806 20:33:39.782642 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 20:33:39.782872 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:33:39.783885 533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:33:39.873632 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 350
I20260806 20:33:39.900206 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 32213
I20260806 20:33:39.901437 32311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:33:40.014998 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 32213
I20260806 20:33:40.048483 13909 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 20:33:40.394762 13909 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 20:33:40.395071 13909 mini_ranger.cc:66] Stopping Ranger...
I20260806 20:33:40.741106 13909 mini_ranger.cc:68] Stopped Ranger
2026-08-06 20:33:40.741 UTC [31531] LOG: received smart shutdown request
2026-08-06 20:33:40.745 UTC [31531] LOG: background worker "logical replication launcher" (PID 31547) exited with exit code 1
2026-08-06 20:33:40.745 UTC [31536] LOG: shutting down
2026-08-06 20:33:40.891 UTC [31531] LOG: database system is shut down
2026-08-06T20:33:40Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51577 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:33:41 dist-test-slave-2kcd krb5kdc[636](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:33:41 dist-test-slave-2kcd krb5kdc[636](info): set up 2 sockets
Aug 06 20:33:41 dist-test-slave-2kcd krb5kdc[636](info): commencing operation
krb5kdc: starting...
W20260806 20:33:42.347733 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.005s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:33:42 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:33:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:33:42Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/rangeradmin_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/rangeradmin_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/rangerlookup_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/rangerlookup_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
I20260806 20:33:42.721849 13909 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdNjTCo/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/postgres -l logfile start
2026-08-06 20:33:45.170 UTC [680] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 20:33:45.170 UTC [680] LOG: listening on IPv4 address "127.13.149.84", port 51999
2026-08-06 20:33:45.173 UTC [680] LOG: listening on Unix socket "/tmp/.s.PGSQL.51999"
2026-08-06 20:33:45.197 UTC [683] LOG: database system was shut down at 2026-08-06 20:33:43 UTC
2026-08-06 20:33:45.200 UTC [680] LOG: database system is ready to accept connections
I20260806 20:33:46.392518 13909 mini_postgres.cc:96] Postgres bound to 51999
2026-08-06 20:33:46.416 UTC [696] FATAL: database "slave" does not exist
127.13.149.84:51999 - accepting connections
I20260806 20:33:46.417584 13909 mini_ranger.cc:161] Starting Ranger...
I20260806 20:33:46.447759 13909 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 20:33:46.883877 13909 mini_ranger.cc:87] Created ranger Postgres database
I20260806 20:33:46.883998 13909 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-admin
2026-08-06 20:33:47,186 [I] DB FLAVOR :POSTGRES
2026-08-06 20:33:47,187 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 20:33:47,187 [I] Checking connection..
2026-08-06 20:33:47,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 20:33:47,432 [I] Checking connection passed.
2026-08-06 20:33:47,433 [I] --------- Verifying version history table ---------
2026-08-06 20:33:47,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 20:33:47,687 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 20:33:47,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 20:33:47,948 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 20:33:47,949 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 20:33:47,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 20:33:48.210 UTC [795] WARNING: there is no transaction in progress
2026-08-06 20:33:48,219 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 20:33:48,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 20:33:48,488 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 20:33:48,489 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 20:33:48,489 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 20:33:48,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 20:33:48,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2kcd.c.gcp-upstream.internal','N') ;"
2026-08-06 20:33:49,242 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 20:33:49,497 [I] Table x_portal_user does not exist in database ranger
2026-08-06 20:33:49,498 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 20:33:49,756 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 20:33:49,757 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 20:33:50,025 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 20:33:50,292 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 20:33:50,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 20:33:51.252 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.268 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.285 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.300 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.316 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.337 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.391 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.397 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.411 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.422 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.433 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.446 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.456 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.462 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.469 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:51.476 UTC [958] WARNING: there is no transaction in progress
2026-08-06 20:33:52,087 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 20:33:52,087 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 20:33:52,339 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 20:33:52,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 20:33:52,606 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 20:33:52,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 20:33:52,873 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 20:33:52,873 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 20:33:53,147 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 20:33:53,403 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2kcd.c.gcp-upstream.internal';"
2026-08-06 20:33:53,663 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 20:33:53,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 20:33:53,935 [I] DB_PATCHES have already been applied
I20260806 20:33:53.941583 13909 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdNjTCo/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 20:33:53.941670 13909 mini_ranger.cc:193] Using host: 127.13.149.84
I20260806 20:33:53.962495 13909 mini_ranger.cc:227] Ranger admin URL: http://127.13.149.84:49295
Aug 06, 2026 8:33:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 8:33:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 8:33:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 8:33:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 8:33:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 8:33:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 8:33:54 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 20:33:55.327155 13909 mini_ranger.cc:160] Time spent starting Ranger: real 8.910s user 0.000s sys 0.056s
Aug 06, 2026 8:34:15 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 8:34:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 8:34:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 8:34:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 8:34:16 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 20:34:17.250658 13909 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/rangerkms_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/rangerkms_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.149.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.149.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.149.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/HTTP_127.13.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 20:34:17 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048457, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 20:34:17.450729 13909 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 20:34:17.473809 13909 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 20:34:18.339604 13909 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 20:34:18.339751 13909 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms
I20260806 20:34:18.339803 13909 mini_ranger_kms.cc:227] Using postgres at 127.13.149.84:51999
2026-08-06 20:34:18,717 [I] DB FLAVOR :POSTGRES
2026-08-06 20:34:18,717 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 20:34:18,717 [I] Checking connection
2026-08-06 20:34:18,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 20:34:18,963 [I] connection success
2026-08-06 20:34:18,963 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 20:34:18,963 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 20:34:18,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 20:34:19,201 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 20:34:19,201 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 20:34:19,201 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 20:34:19,202 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.149.84:51999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 20:34:19,487 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 20:34:19.967285 13909 mini_ranger_kms.cc:310] Created kms service
I20260806 20:34:20.179584 13909 mini_ranger_kms.cc:326] Created kudu user
I20260806 20:34:20.227289 13909 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 20:34:20 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048457, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:20.648504 13909 mini_ranger_kms.cc:384] Added ranger policy
I20260806 20:34:20.648916 13909 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdNjTCo/build/asan/bin/postgresql.jar:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdNjTCo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 20:34:20.648978 13909 mini_ranger_kms.cc:240] Using host: 127.13.149.84
I20260806 20:34:20.672857 13909 mini_ranger_kms.cc:276] Ranger KMS PID: 1238
I20260806 20:34:20.673010 13909 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.149.84:51831
Aug 06, 2026 8:34:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 8:34:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 8:34:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 8:34:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 8:34:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 8:34:22 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 20:34:23 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786048463, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.149.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 20:34:23 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048463, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.149.84@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:23.677958 13909 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.227s user 0.098s sys 0.314s
I20260806 20:34:23.678208 13909 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 20:34:23.678367 13909 mini_ranger_kms.cc:401] 127.13.149.84:51831/kms/v1/keys
Aug 06 20:34:23 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048463, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.149.84@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
Aug 06 20:34:26 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:34:26.439965 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:46713
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:46713
--ranger_config_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:26.797254 1308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:26.797549 1308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:26.797646 1308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:26.805301 1308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:26.805467 1308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:26.805575 1308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:26.805688 1308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:26.805780 1308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:26.816272 1308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.149.84:51831/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:46713
--ranger_config_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:46713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:26.817718 1308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:26.819165 1308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:26.832248 1313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:26.832342 1321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:26.832257 1317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:26.832672 1308 server_base.cc:1034] running on GCE node
I20260806 20:34:26.833662 1308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:26.835188 1308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:26.836445 1308 hybrid_clock.cc:648] HybridClock initialized: now 1786048466836388 us; error 70 us; skew 500 ppm
I20260806 20:34:26.836916 1308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:26 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048466, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:26.840381 1308 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:34:26.841866 1308 webserver.cc:460] Webserver started at http://127.13.149.126:36677/ using document root <none> and password file <none>
I20260806 20:34:26.842535 1308 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:26.842677 1308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:26.842990 1308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:34:26 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048466, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:26.907570 1308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "f980d06dc0cd4df78ad17217affb51d9"
format_stamp: "Formatted at 2026-08-06 20:34:26 on dist-test-slave-2kcd"
server_key: "279ade5458ae901d82a501bf09408318"
server_key_iv: "e2838eb7e2c061d6917e62b5dd624dd0"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:26.908476 1308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "f980d06dc0cd4df78ad17217affb51d9"
format_stamp: "Formatted at 2026-08-06 20:34:26 on dist-test-slave-2kcd"
server_key: "279ade5458ae901d82a501bf09408318"
server_key_iv: "e2838eb7e2c061d6917e62b5dd624dd0"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:26.914116 1308 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260806 20:34:26.930992 1338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:26.932613 1308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 20:34:26.932837 1308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "f980d06dc0cd4df78ad17217affb51d9"
format_stamp: "Formatted at 2026-08-06 20:34:26 on dist-test-slave-2kcd"
server_key: "279ade5458ae901d82a501bf09408318"
server_key_iv: "e2838eb7e2c061d6917e62b5dd624dd0"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:26.933076 1308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:26.959661 1308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:26.964169 1308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:26.964520 1308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:26.985828 1308 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:46713
I20260806 20:34:26.985832 1416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:46713 every 8 connection(s)
I20260806 20:34:26.987269 1308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:34:26.991542 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:26.991667 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 1308
I20260806 20:34:26.991916 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:34:26.992885 13909 external_mini_cluster.cc:1428] Setting key 0db0f47e7284ba37a88f2b95236aa932
I20260806 20:34:27.006489 1417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Bootstrap starting.
I20260806 20:34:27.009902 1417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:27.010986 1417 log.cc:824] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Log is configured to *not* fsync() on all Append() calls
Aug 06 20:34:27 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:27.014380 1417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: No bootstrap required, opened a new log
I20260806 20:34:27.022199 1421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:26.995604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.13.149.126:46713)
0806 20:34:26.996569 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:26.996587 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:26.996645 (+ 58us) server_negotiation.cc:407] Connection header received
0806 20:34:26.998705 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:26.998734 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:26.999268 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:26.999716 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:27.001687 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:27.003889 (+ 2202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:27.006085 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:27.007093 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:27.007262 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:27.012853 (+ 5591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:27.012864 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:27.012883 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:27.012938 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:27.017228 (+ 4290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:27.018106 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:27.018115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:27.018123 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:27.018318 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:27.018793 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:27.018798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:27.018801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:27.019507 (+ 706us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:27.019822 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:27.020351 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 20:34:27.020806 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":703,"thread_start_us":554,"threads_started":1}
I20260806 20:34:27.024570 1417 raft_consensus.cc:348] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:27.025111 1417 raft_consensus.cc:374] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:27.025249 1417 raft_consensus.cc:729] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f980d06dc0cd4df78ad17217affb51d9, State: Initialized, Role: FOLLOWER
I20260806 20:34:27.026057 1417 consensus_queue.cc:260] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:27.026328 1417 raft_consensus.cc:388] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:34:27.026480 1417 raft_consensus.cc:482] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:34:27.026662 1417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:27.029507 1417 raft_consensus.cc:504] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:27.030125 1417 leader_election.cc:302] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f980d06dc0cd4df78ad17217affb51d9; no voters:
I20260806 20:34:27.030895 1417 leader_election.cc:288] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:34:27.031190 1423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:34:27.034487 1417 sys_catalog.cc:564] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:27.038357 1423 raft_consensus.cc:686] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 LEADER]: Becoming Leader. State: Replica: f980d06dc0cd4df78ad17217affb51d9, State: Running, Role: LEADER
I20260806 20:34:27.039074 1423 consensus_queue.cc:237] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:27.042228 1424 sys_catalog.cc:455] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f980d06dc0cd4df78ad17217affb51d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } } }
I20260806 20:34:27.042662 1424 sys_catalog.cc:458] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:27.048981 1425 sys_catalog.cc:455] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f980d06dc0cd4df78ad17217affb51d9. Latest consensus state: current_term: 1 leader_uuid: "f980d06dc0cd4df78ad17217affb51d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } } }
I20260806 20:34:27.049234 1425 sys_catalog.cc:458] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:27.050313 1417 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 20:34:27.051630 1437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:34:27.063841 1437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:34:27.077026 1437 catalog_manager.cc:1347] Generated new cluster ID: 1956b4d5025640c0885b8af869798212
I20260806 20:34:27.077279 1437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:34:27.087051 1437 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:34:27.088650 1437 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:34:27.094836 1437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Generated new TSK 0
I20260806 20:34:27.095657 1437 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:34:27.860829 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46713
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:34:28 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786048468, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 20:34:28.297371 1486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:28.297748 1486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:28.297902 1486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:28.309515 1486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:28.309664 1486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:28.309849 1486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:34:28.325814 1486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.149.84:51831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:28.327479 1486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:28.329241 1486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:28.344285 1507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:28.344949 1508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:28.348591 1486 server_base.cc:1034] running on GCE node
W20260806 20:34:28.348767 1511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:28.349481 1486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:28.350478 1486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:28.351720 1486 hybrid_clock.cc:648] HybridClock initialized: now 1786048468351669 us; error 44 us; skew 500 ppm
I20260806 20:34:28.352044 1486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:28 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048468, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:28.358856 1486 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:34:28.360723 1486 webserver.cc:460] Webserver started at http://127.13.149.65:45947/ using document root <none> and password file <none>
I20260806 20:34:28.361487 1486 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:28.361635 1486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:28.361971 1486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:34:28 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048468, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:28.380992 1486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "f057af38500b4c10a76f31f602b53898"
format_stamp: "Formatted at 2026-08-06 20:34:28 on dist-test-slave-2kcd"
server_key: "818b28f171bc8d436f92b5f8a0200213"
server_key_iv: "fbb2b85cd19c9e3104657ada4dfe8e8d"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:28.382131 1486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "f057af38500b4c10a76f31f602b53898"
format_stamp: "Formatted at 2026-08-06 20:34:28 on dist-test-slave-2kcd"
server_key: "818b28f171bc8d436f92b5f8a0200213"
server_key_iv: "fbb2b85cd19c9e3104657ada4dfe8e8d"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:28.407219 1486 fs_manager.cc:691] Time spent creating directory manager: real 0.025s user 0.008s sys 0.016s
I20260806 20:34:28.436867 1524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:28.439250 1486 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.008s
I20260806 20:34:28.439477 1486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "f057af38500b4c10a76f31f602b53898"
format_stamp: "Formatted at 2026-08-06 20:34:28 on dist-test-slave-2kcd"
server_key: "818b28f171bc8d436f92b5f8a0200213"
server_key_iv: "fbb2b85cd19c9e3104657ada4dfe8e8d"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:28.439805 1486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:28.508975 1486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:28.514848 1486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:28.515257 1486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:28.522771 1486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:28.531019 1486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:28.531152 1486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:28.531298 1486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:28.531369 1486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 20:34:28 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048468, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:28.701615 1486 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:44895
I20260806 20:34:28.701675 1716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:44895 every 8 connection(s)
I20260806 20:34:28.703240 1486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:34:28.707108 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 1486
I20260806 20:34:28.707346 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:34:28.708398 13909 external_mini_cluster.cc:1428] Setting key aba102db5b96a76945b89fd28a0a2839
Aug 06 20:34:28 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048468, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
I20260806 20:34:28.754316 1719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:28.706241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:43573 (local address 127.13.149.126:46713)
0806 20:34:28.728489 (+ 22248us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:28.728497 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:28.728523 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:34:28.730914 (+ 2391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:28.730921 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:28.731055 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:28.731184 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:28.733269 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:28.734652 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:28.737494 (+ 2842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:28.738279 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:28.738418 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:28.743607 (+ 5189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:28.743616 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:28.743624 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:28.743670 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:28.747758 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:28.748496 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:28.748504 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:28.748511 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:28.748696 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:28.752349 (+ 3653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:28.752354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:28.752358 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:28.752640 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:28.752873 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:28.753583 (+ 710us) server_negotiation.cc:299] Negotiation successful
0806 20:34:28.753805 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22110,"thread_start_us":22294,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
I20260806 20:34:28.756929 1721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:28.706891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46713 (local address 127.13.149.65:43573)
0806 20:34:28.725086 (+ 18195us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:28.725156 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:28.730475 (+ 5319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:28.731486 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:28.731500 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:28.732178 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:28.733050 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:28.733078 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:28.734852 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:28.734860 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:28.737315 (+ 2455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:28.737333 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:28.739153 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:28.739166 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:28.739502 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:28.740354 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:28.740388 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:28.743329 (+ 2941us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:28.747912 (+ 4583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:28.747921 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:28.747939 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:28.748359 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:28.751935 (+ 3576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:28.751940 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:28.751945 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:28.752211 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:28.752802 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:28.752811 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:28.753216 (+ 405us) client_negotiation.cc:769] Sending connection context
0806 20:34:28.753483 (+ 267us) client_negotiation.cc:240] Negotiation successful
0806 20:34:28.754026 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17793,"thread_start_us":18343,"threads_started":1}
I20260806 20:34:28.759001 1717 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46713
I20260806 20:34:28.759300 1717 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:28.760146 1717 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
I20260806 20:34:28.762487 1368 ts_manager.cc:194] Registered new tserver with Master: f057af38500b4c10a76f31f602b53898 (127.13.149.65:44895)
I20260806 20:34:28.764398 1368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:43573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:34:28.796597 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46713
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:34:28 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048468, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
W20260806 20:34:29.277529 1725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:29.277809 1725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:29.277968 1725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:29.285185 1725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:29.285287 1725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:29.285499 1725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:34:29.295507 1725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.149.84:51831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:29.296962 1725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:29.298357 1725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:29.312852 1747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:29.312852 1749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:29.314340 1725 server_base.cc:1034] running on GCE node
W20260806 20:34:29.317327 1757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:29.318075 1725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:29.319164 1725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:29.320389 1725 hybrid_clock.cc:648] HybridClock initialized: now 1786048469320337 us; error 47 us; skew 500 ppm
I20260806 20:34:29.320716 1725 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:29 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048469, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:29.323967 1725 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:34:29.325656 1725 webserver.cc:460] Webserver started at http://127.13.149.66:39361/ using document root <none> and password file <none>
I20260806 20:34:29.326427 1725 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:29.326597 1725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:29.327005 1725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:34:29 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048469, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:29.345636 1725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "c4739db607964021ac81a45cac63615f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "7463c6c9495b350eabfcd801ebcb4dbb"
server_key_iv: "24cf6ed64537ff033e8772c28016df62"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:29.346746 1725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "c4739db607964021ac81a45cac63615f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "7463c6c9495b350eabfcd801ebcb4dbb"
server_key_iv: "24cf6ed64537ff033e8772c28016df62"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:29.354166 1725 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260806 20:34:29.372329 1769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:29.374332 1725 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 20:34:29.374560 1725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "c4739db607964021ac81a45cac63615f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "7463c6c9495b350eabfcd801ebcb4dbb"
server_key_iv: "24cf6ed64537ff033e8772c28016df62"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:29.374854 1725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:29.395361 1725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:29.400743 1725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:29.401154 1725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:29.402392 1725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:29.404268 1725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:29.404372 1725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:29.404562 1725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:29.404629 1725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:29.445745 1725 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:41109
I20260806 20:34:29.445781 1932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:41109 every 8 connection(s)
I20260806 20:34:29.447630 1725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:34:29.451562 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 1725
I20260806 20:34:29.451783 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:34:29.452556 13909 external_mini_cluster.cc:1428] Setting key 5e49ece363711f2481d6f22bc1e16791
Aug 06 20:34:29 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048469, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:29.480749 1941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:29.451921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:54813 (local address 127.13.149.126:46713)
0806 20:34:29.459141 (+ 7220us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:29.459148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:29.459170 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:34:29.459236 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:29.459245 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:29.459353 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:29.459471 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:29.461810 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:29.463047 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:29.465645 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:29.466431 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:29.466549 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:29.471406 (+ 4857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:29.471416 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:29.471424 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:29.471473 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:29.475526 (+ 4053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:29.476629 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:29.476637 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:29.476644 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:29.476889 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:29.477487 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:29.477494 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:29.477501 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:29.477909 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:29.478050 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:29.479963 (+ 1913us) server_negotiation.cc:299] Negotiation successful
0806 20:34:29.480229 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7067,"thread_start_us":6995,"threads_started":1}
I20260806 20:34:29.482995 1940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:29.451309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46713 (local address 127.13.149.66:54813)
0806 20:34:29.453739 (+ 2430us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:29.453793 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:29.456294 (+ 2501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:29.459926 (+ 3632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:29.459940 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:29.460616 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:29.461569 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:29.461602 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:29.463258 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:29.463267 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:29.465469 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:29.465488 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:29.466926 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:29.466936 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:29.467277 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:29.468151 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:29.468187 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:29.471118 (+ 2931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:29.475720 (+ 4602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:29.475733 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:29.475756 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:29.476471 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:29.477030 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:29.477037 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:29.477043 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:29.477322 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:29.478135 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:29.478147 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:29.478696 (+ 549us) client_negotiation.cc:769] Sending connection context
0806 20:34:29.479012 (+ 316us) client_negotiation.cc:240] Negotiation successful
0806 20:34:29.479666 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2110,"thread_start_us":1880,"threads_started":1}
I20260806 20:34:29.485044 1937 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46713
I20260806 20:34:29.485401 1937 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:29.486382 1937 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
I20260806 20:34:29.488255 1368 ts_manager.cc:194] Registered new tserver with Master: c4739db607964021ac81a45cac63615f (127.13.149.66:41109)
I20260806 20:34:29.489634 1368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:54813
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:34:29.527900 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46713
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:34:29.767997 1717 heartbeater.cc:503] Master 127.13.149.126:46713 was elected leader, sending a full tablet report...
W20260806 20:34:29.880110 1946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:29.880441 1946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:29.880586 1946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:29.887966 1946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:29.888127 1946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:29.888305 1946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:34:29.898772 1946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.149.84:51831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:46713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:29.900156 1946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:29.901516 1946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:29.916165 1954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:29.916628 1952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:29.916674 1957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:29.917174 1946 server_base.cc:1034] running on GCE node
I20260806 20:34:29.917865 1946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:29.918799 1946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:29.920013 1946 hybrid_clock.cc:648] HybridClock initialized: now 1786048469919967 us; error 41 us; skew 500 ppm
I20260806 20:34:29.920398 1946 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:29 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048469, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:29.923691 1946 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:34:29.925380 1946 webserver.cc:460] Webserver started at http://127.13.149.67:45933/ using document root <none> and password file <none>
I20260806 20:34:29.926097 1946 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:29.926271 1946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:29.926748 1946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 20:34:29 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048469, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:29.946298 1946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "ff3d58d3356b4404be32c7917b099b8f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "55fca95787d36fa46d3697b37dfe6490"
server_key_iv: "c547e46cb867c445b2e4433fff555282"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:29.947535 1946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "ff3d58d3356b4404be32c7917b099b8f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "55fca95787d36fa46d3697b37dfe6490"
server_key_iv: "c547e46cb867c445b2e4433fff555282"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:29.954919 1946 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260806 20:34:29.973738 1969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:29.975543 1946 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 20:34:29.975737 1946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "ff3d58d3356b4404be32c7917b099b8f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "55fca95787d36fa46d3697b37dfe6490"
server_key_iv: "c547e46cb867c445b2e4433fff555282"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:29.976016 1946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:30.011579 1946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:30.015741 1946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:30.016019 1946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:30.016987 1946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:30.018334 1946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:30.018414 1946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:30.018501 1946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:30.018551 1946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:30.053668 1946 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:43025
I20260806 20:34:30.053714 2137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:43025 every 8 connection(s)
I20260806 20:34:30.054976 1946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:34:30.059302 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 1946
I20260806 20:34:30.059514 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:34:30.060009 13909 external_mini_cluster.cc:1428] Setting key 7fd6837dadf9458e471cbd9957d44eba
Aug 06 20:34:30 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048469, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:30.075151 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:30.057720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:47201 (local address 127.13.149.126:46713)
0806 20:34:30.058207 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:30.058211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:30.059230 (+ 1019us) server_negotiation.cc:407] Connection header received
0806 20:34:30.061385 (+ 2155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:30.061394 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:30.061478 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:30.061575 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:30.063063 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.063850 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.065411 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.065845 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.065956 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:30.069284 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:30.069289 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:30.069293 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:30.069323 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:30.072051 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.072693 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.072698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.072700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.072893 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.073277 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.073280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.073282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.073557 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:30.073727 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:30.074543 (+ 816us) server_negotiation.cc:299] Negotiation successful
0806 20:34:30.074763 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":237,"threads_started":1}
I20260806 20:34:30.076084 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:30.058367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46713 (local address 127.13.149.67:47201)
0806 20:34:30.059072 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:30.059108 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:30.061072 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:30.061771 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:30.061778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:30.062284 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:30.062865 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:30.062910 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.063998 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.064002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:30.065269 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:30.065281 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.066100 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.066108 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:30.066318 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:30.066942 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:30.066964 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:30.069084 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:30.072172 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:30.072178 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:30.072187 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:30.072576 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:30.072991 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:30.072994 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:30.072997 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:30.073178 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:30.073698 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:30.073706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:30.074120 (+ 414us) client_negotiation.cc:769] Sending connection context
0806 20:34:30.074431 (+ 311us) client_negotiation.cc:240] Negotiation successful
0806 20:34:30.074915 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":281,"threads_started":1}
I20260806 20:34:30.077399 2139 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46713
I20260806 20:34:30.077654 2139 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:30.078344 2139 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
I20260806 20:34:30.079630 1368 ts_manager.cc:194] Registered new tserver with Master: ff3d58d3356b4404be32c7917b099b8f (127.13.149.67:43025)
I20260806 20:34:30.080430 1368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:47201
I20260806 20:34:30.087584 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:34:30.089466 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 1486
Aug 06 20:34:30 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:34:30.106091 2148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:30.090307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33814 (local address 127.13.149.65:44895)
0806 20:34:30.090922 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:30.090928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:30.090952 (+ 24us) server_negotiation.cc:407] Connection header received
0806 20:34:30.091006 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:30.091012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:30.091171 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:30.091297 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:30.092721 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.093831 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.095235 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.095762 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.095869 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:30.100343 (+ 4474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:30.100355 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:30.100369 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:30.100406 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:30.103071 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.103830 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.103838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.103840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.103989 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.104383 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.104390 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.104395 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.104725 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:30.105118 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:30.105451 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 20:34:30.105732 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":310,"threads_started":1}
I20260806 20:34:30.107285 1706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:30.189590 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 1486
I20260806 20:34:30.211813 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 1725
Aug 06 20:34:30 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:34:30.228423 2153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:30.212769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34120 (local address 127.13.149.66:41109)
0806 20:34:30.213496 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:30.213503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:30.213530 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:34:30.213591 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:30.213597 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:30.213848 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:30.213998 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:30.215233 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.216241 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.217773 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.218331 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.218448 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:30.222674 (+ 4226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:30.222685 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:30.222699 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:30.222730 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:30.225694 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.226397 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.226404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.226406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.226533 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.226879 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.226882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.226884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.227207 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:30.227443 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:30.227802 (+ 359us) server_negotiation.cc:299] Negotiation successful
0806 20:34:30.228054 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":401,"threads_started":1}
I20260806 20:34:30.229746 1925 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:30.316483 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 1725
I20260806 20:34:30.344529 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 1946
Aug 06 20:34:30 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:34:30.360455 2157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:30.345506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42214 (local address 127.13.149.67:43025)
0806 20:34:30.346171 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:30.346178 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:30.346209 (+ 31us) server_negotiation.cc:407] Connection header received
0806 20:34:30.346270 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:30.346277 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:30.346494 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:30.346636 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:30.347911 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.349141 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.350414 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:30.350967 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:30.351061 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:30.355397 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:30.355408 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:30.355424 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:30.355456 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:30.358101 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.358683 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.358689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.358692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.358813 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:30.359128 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:30.359131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:30.359132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:30.359444 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:30.359686 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:30.359981 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 20:34:30.360171 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":316,"threads_started":1}
I20260806 20:34:30.361807 2130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:30.445387 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 1946
I20260806 20:34:30.468607 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 1308
I20260806 20:34:30.470002 1411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:30.576557 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 1308
I20260806 20:34:30.612368 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:46713
--webserver_interface=127.13.149.126
--webserver_port=36677
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:46713
--ranger_config_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:30.948671 2161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:30.949038 2161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:30.949133 2161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:30.956153 2161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:30.956248 2161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:30.956295 2161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:30.956354 2161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:30.956404 2161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:30.966125 2161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:46713
--ranger_config_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:46713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=36677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:30.967329 2161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:30.968544 2161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:30.980600 2168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:30.980466 2170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:30.980427 2172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:30.981653 2161 server_base.cc:1034] running on GCE node
I20260806 20:34:30.982358 2161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:30.983668 2161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:30.984879 2161 hybrid_clock.cc:648] HybridClock initialized: now 1786048470984846 us; error 47 us; skew 500 ppm
I20260806 20:34:30.985232 2161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:30 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048470, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:30.988377 2161 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:34:30.989886 2161 webserver.cc:460] Webserver started at http://127.13.149.126:36677/ using document root <none> and password file <none>
I20260806 20:34:30.990494 2161 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:30.990609 2161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 20:34:31 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048470, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:31.036072 2161 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 20:34:31.039392 2185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:31.040946 2161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:34:31.041139 2161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "f980d06dc0cd4df78ad17217affb51d9"
format_stamp: "Formatted at 2026-08-06 20:34:26 on dist-test-slave-2kcd"
server_key: "279ade5458ae901d82a501bf09408318"
server_key_iv: "e2838eb7e2c061d6917e62b5dd624dd0"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:31.042127 2161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:31.067657 2161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:31.071782 2161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:31.072077 2161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:31.090560 2161 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:46713
I20260806 20:34:31.090582 2264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:46713 every 8 connection(s)
I20260806 20:34:31.092048 2161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:34:31.098910 2269 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:34:31.100100 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 2161
I20260806 20:34:31.101171 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:44895
--local_ip_for_outbound_sockets=127.13.149.65
--tserver_master_addrs=127.13.149.126:46713
--webserver_port=45947
--webserver_interface=127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:34:31.102453 2269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Bootstrap starting.
I20260806 20:34:31.121315 2269 log.cc:824] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:31.130228 2269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:34:31.130779 2269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Bootstrap complete.
I20260806 20:34:31.139879 2269 raft_consensus.cc:348] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:31.140725 2269 raft_consensus.cc:729] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f980d06dc0cd4df78ad17217affb51d9, State: Initialized, Role: FOLLOWER
I20260806 20:34:31.141366 2269 consensus_queue.cc:260] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:31.141609 2269 raft_consensus.cc:388] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:34:31.141884 2269 raft_consensus.cc:482] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:34:31.142113 2269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 1 FOLLOWER]: Advancing to term 2
I20260806 20:34:31.145983 2269 raft_consensus.cc:504] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:31.146559 2269 leader_election.cc:302] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f980d06dc0cd4df78ad17217affb51d9; no voters:
I20260806 20:34:31.147233 2269 leader_election.cc:288] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 20:34:31.147411 2276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 20:34:31.148517 2276 raft_consensus.cc:686] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [term 2 LEADER]: Becoming Leader. State: Replica: f980d06dc0cd4df78ad17217affb51d9, State: Running, Role: LEADER
I20260806 20:34:31.149166 2276 consensus_queue.cc:237] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } }
I20260806 20:34:31.149601 2269 sys_catalog.cc:564] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:31.151753 2277 sys_catalog.cc:455] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f980d06dc0cd4df78ad17217affb51d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } } }
I20260806 20:34:31.152202 2277 sys_catalog.cc:458] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:31.152765 2280 sys_catalog.cc:455] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f980d06dc0cd4df78ad17217affb51d9. Latest consensus state: current_term: 2 leader_uuid: "f980d06dc0cd4df78ad17217affb51d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f980d06dc0cd4df78ad17217affb51d9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 46713 } } }
I20260806 20:34:31.153122 2280 sys_catalog.cc:458] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:31.156977 2285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:34:31.162724 2285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:34:31.163761 2285 catalog_manager.cc:1259] Loaded cluster ID: 1956b4d5025640c0885b8af869798212
I20260806 20:34:31.163888 2285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:34:31.169194 2285 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:34:31.171101 2285 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Loaded TSK: 0
I20260806 20:34:31.173159 2285 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:34:31.183419 2269 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260806 20:34:31.580116 2274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:31.580621 2274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:31.580853 2274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:31.592754 2274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:31.592962 2274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:31.593195 2274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:34:31.608947 2274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:44895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=45947
--tserver_master_addrs=127.13.149.126:46713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:31.610886 2274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:31.612687 2274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:31.636574 2330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:31.638115 2329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:31.638921 2335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:31.640388 2274 server_base.cc:1034] running on GCE node
I20260806 20:34:31.641144 2274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:31.642441 2274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:31.643747 2274 hybrid_clock.cc:648] HybridClock initialized: now 1786048471643674 us; error 62 us; skew 500 ppm
I20260806 20:34:31.644131 2274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:31 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048471, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:31.647579 2274 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:34:31.649356 2274 webserver.cc:460] Webserver started at http://127.13.149.65:45947/ using document root <none> and password file <none>
I20260806 20:34:31.650103 2274 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:31.650255 2274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 20:34:31 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048471, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:31.683122 2274 fs_manager.cc:709] Time spent opening directory manager: real 0.016s user 0.012s sys 0.004s
I20260806 20:34:31.695104 2345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:31.697440 2274 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.010s sys 0.000s
I20260806 20:34:31.697670 2274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "f057af38500b4c10a76f31f602b53898"
format_stamp: "Formatted at 2026-08-06 20:34:28 on dist-test-slave-2kcd"
server_key: "818b28f171bc8d436f92b5f8a0200213"
server_key_iv: "fbb2b85cd19c9e3104657ada4dfe8e8d"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:31.699232 2274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:31.725936 2274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:31.731153 2274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:31.731565 2274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:31.732969 2274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:31.734856 2274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:31.734973 2274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:31.735090 2274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:31.735172 2274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:31.791352 2274 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:44895
I20260806 20:34:31.791400 2515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:44895 every 8 connection(s)
I20260806 20:34:31.793133 2274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:34:31.795272 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 2274
I20260806 20:34:31.796154 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:41109
--local_ip_for_outbound_sockets=127.13.149.66
--tserver_master_addrs=127.13.149.126:46713
--webserver_port=39361
--webserver_interface=127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:34:31 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048471, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:31.833927 2519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:31.797949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:54443 (local address 127.13.149.126:46713)
0806 20:34:31.805924 (+ 7975us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:31.805946 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:31.807976 (+ 2030us) server_negotiation.cc:407] Connection header received
0806 20:34:31.809310 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:31.809332 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:31.809811 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:31.810173 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:31.812713 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:31.814877 (+ 2164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:31.817561 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:31.818702 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:31.818878 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:31.824122 (+ 5244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:31.824135 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:31.824155 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:31.824209 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:31.828104 (+ 3895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:31.829164 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:31.829172 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:31.829181 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:31.829389 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:31.829963 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:31.829968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:31.829971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:31.830628 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:31.830811 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:31.831937 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0806 20:34:31.832410 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7619,"thread_start_us":7711,"threads_started":1}
I20260806 20:34:31.834609 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:31.799037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46713 (local address 127.13.149.65:54443)
0806 20:34:31.806080 (+ 7043us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:31.806137 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:31.808551 (+ 2414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:31.811003 (+ 2452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:31.811014 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:31.811608 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:31.812372 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:31.812397 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:31.815099 (+ 2702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:31.815107 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:31.817369 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:31.817399 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:31.819329 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:31.819338 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:31.819698 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:31.820723 (+ 1025us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:31.820759 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:31.823774 (+ 3015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:31.828273 (+ 4499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:31.828282 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:31.828297 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:31.828982 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:31.829561 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:31.829566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:31.829569 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:31.829820 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:31.830917 (+ 1097us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:31.830926 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:31.831310 (+ 384us) client_negotiation.cc:769] Sending connection context
0806 20:34:31.832874 (+ 1564us) client_negotiation.cc:240] Negotiation successful
0806 20:34:31.833394 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6098,"thread_start_us":5875,"threads_started":1}
I20260806 20:34:31.837949 2516 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46713
I20260806 20:34:31.838258 2516 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:31.839066 2516 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
W20260806 20:34:31.842129 2516 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:46713 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 20:34:31.842362 2516 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:31.842633 2516 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
I20260806 20:34:31.843873 2516 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:31.844143 2516 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
W20260806 20:34:31.845345 2516 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 20:34:32.234136 2522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:32.234503 2522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:32.234691 2522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:32.242722 2522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:32.242892 2522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:32.243083 2522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:34:32.258961 2522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:41109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=39361
--tserver_master_addrs=127.13.149.126:46713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:32.260656 2522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:32.262399 2522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:32.284142 2543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:32.287040 2544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:32.287268 2551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:32.288640 2522 server_base.cc:1034] running on GCE node
I20260806 20:34:32.289433 2522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:32.290704 2522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:32.291982 2522 hybrid_clock.cc:648] HybridClock initialized: now 1786048472291871 us; error 89 us; skew 500 ppm
I20260806 20:34:32.292361 2522 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:32 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048472, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:32.296633 2522 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:34:32.300113 2522 webserver.cc:460] Webserver started at http://127.13.149.66:39361/ using document root <none> and password file <none>
I20260806 20:34:32.301084 2522 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:32.301251 2522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 20:34:32 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048472, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:32.337984 2522 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.011s sys 0.004s
I20260806 20:34:32.348217 2563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:32.350281 2522 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.009s sys 0.000s
I20260806 20:34:32.350564 2522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "c4739db607964021ac81a45cac63615f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "7463c6c9495b350eabfcd801ebcb4dbb"
server_key_iv: "24cf6ed64537ff033e8772c28016df62"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:32.352174 2522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:32.395043 2522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:32.400839 2522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:32.401188 2522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:32.402609 2522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:32.404541 2522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:32.404731 2522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 20:34:32.404938 2522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:32.405035 2522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:32.453910 2522 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:41109
I20260806 20:34:32.453981 2752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:41109 every 8 connection(s)
I20260806 20:34:32.456063 2522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
Aug 06 20:34:32 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786048472, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:32.461721 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 2522
I20260806 20:34:32.462505 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.149.84:51831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:43025
--local_ip_for_outbound_sockets=127.13.149.67
--tserver_master_addrs=127.13.149.126:46713
--webserver_port=45933
--webserver_interface=127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:34:32 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048472, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:32.511724 2761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:32.460728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:36071 (local address 127.13.149.126:46713)
0806 20:34:32.486890 (+ 26162us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:32.486898 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:32.491652 (+ 4754us) server_negotiation.cc:407] Connection header received
0806 20:34:32.491744 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:32.491750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:32.491895 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:32.492020 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:32.494448 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:32.495634 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:32.498139 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:32.498827 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:32.498934 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:32.503760 (+ 4826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:32.503768 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:32.503773 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:32.503818 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:32.507634 (+ 3816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:32.508658 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:32.508664 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:32.508668 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:32.508851 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:32.509463 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:32.509469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:32.509472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:32.509846 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:32.510001 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:32.511038 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0806 20:34:32.511310 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25985,"thread_start_us":31442,"threads_started":1}
I20260806 20:34:32.514348 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:32.460054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46713 (local address 127.13.149.66:36071)
0806 20:34:32.487613 (+ 27559us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:32.487682 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:32.490315 (+ 2633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:32.492621 (+ 2306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:32.492634 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:32.493371 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:32.494203 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:32.494229 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:32.495863 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:32.495869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:32.497952 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:32.497978 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:32.499345 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:32.499351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:32.499693 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:32.500549 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:32.500583 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:32.503495 (+ 2912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:32.507808 (+ 4313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:32.507817 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:32.507835 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:32.508483 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:32.509007 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:32.509012 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:32.509016 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:32.509298 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:32.510110 (+ 812us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:32.510119 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:32.510575 (+ 456us) client_negotiation.cc:769] Sending connection context
0806 20:34:32.512302 (+ 1727us) client_negotiation.cc:240] Negotiation successful
0806 20:34:32.512938 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27137,"thread_start_us":30631,"threads_started":1}
I20260806 20:34:32.516404 2754 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46713
I20260806 20:34:32.516741 2754 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:32.517707 2754 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
I20260806 20:34:32.520002 2206 ts_manager.cc:194] Registered new tserver with Master: c4739db607964021ac81a45cac63615f (127.13.149.66:41109)
I20260806 20:34:32.522356 2206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:36071
I20260806 20:34:32.845491 2516 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:32.845924 2516 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
I20260806 20:34:32.847550 2206 ts_manager.cc:194] Registered new tserver with Master: f057af38500b4c10a76f31f602b53898 (127.13.149.65:44895)
I20260806 20:34:32.848752 2206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:54443
Aug 06 20:34:32 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048472, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
W20260806 20:34:32.942677 2762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:32.943189 2762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:32.943377 2762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:32.954710 2762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:32.954939 2762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:32.955173 2762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:34:32.970630 2762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.149.84:51831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:43025
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=45933
--tserver_master_addrs=127.13.149.126:46713
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:32.972556 2762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:32.974287 2762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:33.010016 2782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:33.013213 2781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:33.029799 2762 server_base.cc:1034] running on GCE node
W20260806 20:34:33.041153 2787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:33.042244 2762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:33.047977 2762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:33.063570 2762 hybrid_clock.cc:648] HybridClock initialized: now 1786048473063395 us; error 184 us; skew 500 ppm
I20260806 20:34:33.064052 2762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:33 dist-test-slave-2kcd krb5kdc[636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048473, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:33.068583 2762 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:34:33.109104 2762 webserver.cc:460] Webserver started at http://127.13.149.67:45933/ using document root <none> and password file <none>
I20260806 20:34:33.110258 2762 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:33.110502 2762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 20:34:33 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048473, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:33.137449 2762 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 20:34:33.141618 2804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:33.143640 2762 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 20:34:33.143838 2762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "ff3d58d3356b4404be32c7917b099b8f"
format_stamp: "Formatted at 2026-08-06 20:34:29 on dist-test-slave-2kcd"
server_key: "55fca95787d36fa46d3697b37dfe6490"
server_key_iv: "c547e46cb867c445b2e4433fff555282"
server_key_version: "kuduclusterkey@0"
I20260806 20:34:33.145707 2762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:33.198050 2762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:33.203395 2762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:33.203779 2762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:33.211167 2762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:33.219210 2762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:33.219378 2762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:33.219566 2762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:33.219702 2762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:33.322214 2762 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:43025
I20260806 20:34:33.322280 2973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:43025 every 8 connection(s)
I20260806 20:34:33.324220 2762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:34:33.326215 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 2762
I20260806 20:34:33.354029 2982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.327623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34440 (local address 127.13.149.126:46713)
0806 20:34:33.333554 (+ 5931us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.333560 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.334298 (+ 738us) server_negotiation.cc:407] Connection header received
0806 20:34:33.334374 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.334380 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.334481 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.334613 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:33.337452 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.338911 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.341118 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.341813 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.341947 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.345940 (+ 3993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:33.345947 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:33.345952 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:33.345992 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:33.349863 (+ 3871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.350826 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.350832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.350835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.350987 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.351460 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.351465 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.351468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.351844 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:33.352107 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.353378 (+ 1271us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.353628 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5727,"thread_start_us":5605,"threads_started":1}
Aug 06 20:34:33 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048473, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:33.377810 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.333675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44375 (local address 127.13.149.126:46713)
0806 20:34:33.348356 (+ 14681us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.348362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.348381 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:34:33.350203 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.350210 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.350284 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.350384 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:33.352654 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.353886 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.358661 (+ 4775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.359362 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.359450 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.368629 (+ 9179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:33.368636 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:33.368641 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:33.368678 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:33.372259 (+ 3581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.373288 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.373295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.373301 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.373444 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.374028 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.374032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.374035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.374433 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:33.374585 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.377142 (+ 2557us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.377369 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14535,"thread_start_us":14717,"threads_started":1}
I20260806 20:34:33.378661 2984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.334439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:46713 (local address 127.13.149.67:44375)
0806 20:34:33.344829 (+ 10390us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.344879 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.349675 (+ 4796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.350852 (+ 1177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.350866 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.351555 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:33.352433 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.352458 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.354099 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.354105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.358499 (+ 4394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.358513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.359781 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.359788 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.360058 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.364921 (+ 4863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:33.364953 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:33.368307 (+ 3354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:33.372427 (+ 4120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:33.372436 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:33.372453 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:33.373134 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:33.373587 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:33.373592 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:33.373595 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:33.373869 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:33.374661 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:33.374668 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:33.375125 (+ 457us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.375466 (+ 341us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.376055 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10063,"thread_start_us":10346,"threads_started":1}
I20260806 20:34:33.381670 2974 heartbeater.cc:347] Connected to a master server at 127.13.149.126:46713
I20260806 20:34:33.382015 2974 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:33.382886 2974 heartbeater.cc:511] Master 127.13.149.126:46713 requested a full tablet report, sending...
I20260806 20:34:33.384519 2205 ts_manager.cc:194] Registered new tserver with Master: ff3d58d3356b4404be32c7917b099b8f (127.13.149.67:43025)
I20260806 20:34:33.385517 2205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:44375
Aug 06 20:34:33 dist-test-slave-2kcd krb5kdc[636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048472, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for HTTP/127.13.149.84@KRBTEST.COM
I20260806 20:34:33.398064 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:34:33.470918 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.431570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34442 (local address 127.13.149.126:46713)
0806 20:34:33.431774 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.431780 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.440288 (+ 8508us) server_negotiation.cc:407] Connection header received
0806 20:34:33.440644 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.440650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.440767 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.440896 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:33.454185 (+ 13289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.455279 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.457433 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.458116 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.458221 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.462813 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:33.462820 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:33.462825 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:33.462869 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:33.466662 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.467639 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.467645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.467648 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.467819 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.468308 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.468313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.468316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.468727 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:33.469007 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.470264 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.470549 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 20:34:33.477676 2205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:34:33.495429 2205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:34:33.527005 2754 heartbeater.cc:503] Master 127.13.149.126:46713 was elected leader, sending a full tablet report...
I20260806 20:34:33.561697 3003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.528987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44895 (local address 127.0.0.1:40916)
0806 20:34:33.548374 (+ 19387us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.548394 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.548515 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.549746 (+ 1231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.549754 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.549789 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:33.550295 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.550309 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.554536 (+ 4227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.554542 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.556827 (+ 2285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.556851 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.560716 (+ 3865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.560725 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.560946 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.561009 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.561138 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.561334 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19261,"thread_start_us":17085,"threads_started":1}
I20260806 20:34:33.563683 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.529738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.13.149.65:44895)
0806 20:34:33.547305 (+ 17567us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.547315 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.549005 (+ 1690us) server_negotiation.cc:407] Connection header received
0806 20:34:33.549129 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.549137 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.549492 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.550632 (+ 1140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:33.550888 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.553624 (+ 2736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.557085 (+ 3461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.559753 (+ 2668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.562853 (+ 3100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.563107 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.563180 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.563345 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17379,"thread_start_us":17883,"threads_started":1}
I20260806 20:34:33.569115 2414 tablet_service.cc:1467] Processing CreateTablet for tablet 023d1c3f47a24217ac42a433a89190be (DEFAULT_TABLE table=test-table [id=052cb567072842a2b0182da5749f1a46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:33.570767 2414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 023d1c3f47a24217ac42a433a89190be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:33.571688 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.528280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:41109 (local address 127.0.0.1:49134)
0806 20:34:33.546490 (+ 18210us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.546532 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.546729 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.558931 (+ 12202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.558938 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.558966 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:33.559360 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.559374 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.564955 (+ 5581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.564961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.567062 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.567078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.570876 (+ 3798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.570883 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.571061 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.571099 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.571173 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.571310 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17955,"thread_start_us":19842,"threads_started":1}
I20260806 20:34:33.575829 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.528549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49134 (local address 127.13.149.66:41109)
0806 20:34:33.547307 (+ 18758us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.547316 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.547353 (+ 37us) server_negotiation.cc:407] Connection header received
0806 20:34:33.557787 (+ 10434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.557797 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.558081 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.559615 (+ 1534us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:33.559877 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.562186 (+ 2309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.567278 (+ 5092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.568802 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.571950 (+ 3148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.572177 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.572250 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.572421 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18546,"thread_start_us":18794,"threads_started":1}
I20260806 20:34:33.578155 3003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.548821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43025 (local address 127.0.0.1:34632)
0806 20:34:33.562301 (+ 13480us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.562320 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.562413 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.563832 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.563836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.563862 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:33.564056 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.564067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.572903 (+ 8836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.572908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.574693 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.574710 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.577394 (+ 2684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.577401 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.577616 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.577655 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.577733 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.577877 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13367,"thread_start_us":28123,"threads_started":1}
I20260806 20:34:33.579244 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.548981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34632 (local address 127.13.149.67:43025)
0806 20:34:33.562997 (+ 14016us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.563005 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.563040 (+ 35us) server_negotiation.cc:407] Connection header received
0806 20:34:33.563137 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.563144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.563366 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.564239 (+ 873us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:33.564543 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.570614 (+ 6071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.574918 (+ 4304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.577194 (+ 2276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.578401 (+ 1207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.578664 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.578743 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.578910 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13840,"thread_start_us":14539,"threads_started":1}
I20260806 20:34:33.581559 2647 tablet_service.cc:1467] Processing CreateTablet for tablet 023d1c3f47a24217ac42a433a89190be (DEFAULT_TABLE table=test-table [id=052cb567072842a2b0182da5749f1a46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:33.583199 2647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 023d1c3f47a24217ac42a433a89190be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:33.582902 2877 tablet_service.cc:1467] Processing CreateTablet for tablet 023d1c3f47a24217ac42a433a89190be (DEFAULT_TABLE table=test-table [id=052cb567072842a2b0182da5749f1a46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:33.584208 2877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 023d1c3f47a24217ac42a433a89190be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:33.609401 3013 tablet_bootstrap.cc:492] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Bootstrap starting.
I20260806 20:34:33.611459 3012 tablet_bootstrap.cc:492] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Bootstrap starting.
I20260806 20:34:33.614118 3013 tablet_bootstrap.cc:654] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:33.615231 3012 tablet_bootstrap.cc:654] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:33.616485 3012 log.cc:824] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:33.618070 3014 tablet_bootstrap.cc:492] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Bootstrap starting.
I20260806 20:34:33.622666 3014 tablet_bootstrap.cc:654] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:33.623850 3013 log.cc:824] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:33.623905 3014 log.cc:824] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:33.629056 3014 tablet_bootstrap.cc:492] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: No bootstrap required, opened a new log
I20260806 20:34:33.629962 3014 ts_tablet_manager.cc:1397] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260806 20:34:33.631488 3012 tablet_bootstrap.cc:492] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: No bootstrap required, opened a new log
I20260806 20:34:33.631800 3012 ts_tablet_manager.cc:1397] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.008s
I20260806 20:34:33.639653 3013 tablet_bootstrap.cc:492] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: No bootstrap required, opened a new log
I20260806 20:34:33.639981 3013 ts_tablet_manager.cc:1397] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Time spent bootstrapping tablet: real 0.031s user 0.016s sys 0.000s
I20260806 20:34:33.642767 3014 raft_consensus.cc:348] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.643376 3014 raft_consensus.cc:374] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:33.643532 3014 raft_consensus.cc:729] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3d58d3356b4404be32c7917b099b8f, State: Initialized, Role: FOLLOWER
I20260806 20:34:33.644359 3014 consensus_queue.cc:260] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.650614 3013 raft_consensus.cc:348] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.650640 3012 raft_consensus.cc:348] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.651168 3013 raft_consensus.cc:374] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:33.651364 3013 raft_consensus.cc:729] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f057af38500b4c10a76f31f602b53898, State: Initialized, Role: FOLLOWER
I20260806 20:34:33.652105 3013 consensus_queue.cc:260] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.652968 3014 ts_tablet_manager.cc:1428] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Time spent starting tablet: real 0.023s user 0.015s sys 0.005s
I20260806 20:34:33.653510 2974 heartbeater.cc:503] Master 127.13.149.126:46713 was elected leader, sending a full tablet report...
I20260806 20:34:33.657445 3012 raft_consensus.cc:374] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:33.657706 3012 raft_consensus.cc:729] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4739db607964021ac81a45cac63615f, State: Initialized, Role: FOLLOWER
I20260806 20:34:33.658614 3012 consensus_queue.cc:260] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.661317 2516 heartbeater.cc:503] Master 127.13.149.126:46713 was elected leader, sending a full tablet report...
I20260806 20:34:33.662164 3013 ts_tablet_manager.cc:1428] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Time spent starting tablet: real 0.022s user 0.012s sys 0.007s
I20260806 20:34:33.666798 3012 ts_tablet_manager.cc:1428] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Time spent starting tablet: real 0.035s user 0.015s sys 0.000s
W20260806 20:34:33.714591 2758 tablet.cc:2369] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:33.796507 3029 raft_consensus.cc:482] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:34:33.796851 3029 raft_consensus.cc:504] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.798878 3029 leader_election.cc:288] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3d58d3356b4404be32c7917b099b8f (127.13.149.67:43025), f057af38500b4c10a76f31f602b53898 (127.13.149.65:44895)
I20260806 20:34:33.799568 3021 raft_consensus.cc:482] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:34:33.799935 3021 raft_consensus.cc:504] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.802069 3021 leader_election.cc:288] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4739db607964021ac81a45cac63615f (127.13.149.66:41109), f057af38500b4c10a76f31f602b53898 (127.13.149.65:44895)
W20260806 20:34:33.804375 2517 tablet.cc:2369] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:33.808370 3044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.799195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44895 (local address 127.13.149.66:36731)
0806 20:34:33.799944 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.799959 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.800132 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.800725 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.800731 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.800762 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:33.801263 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.801280 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.803100 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.803106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.805489 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.805503 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.807372 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.807378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.807641 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.807681 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.807783 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.807917 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"mutex_wait_us":35,"thread_start_us":880,"threads_started":1}
I20260806 20:34:33.808612 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.799591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:36731 (local address 127.13.149.65:44895)
0806 20:34:33.799809 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.799815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.800054 (+ 239us) server_negotiation.cc:407] Connection header received
0806 20:34:33.800324 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.800329 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.800416 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.800504 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:33.801468 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.802637 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.805679 (+ 3042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.806987 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.807151 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.807228 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.808184 (+ 956us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.808348 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:34:33.809813 2443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "023d1c3f47a24217ac42a433a89190be" candidate_uuid: "c4739db607964021ac81a45cac63615f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f057af38500b4c10a76f31f602b53898" is_pre_election: true
I20260806 20:34:33.810420 2443 raft_consensus.cc:2454] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4739db607964021ac81a45cac63615f in term 0.
I20260806 20:34:33.811120 2567 leader_election.cc:302] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4739db607964021ac81a45cac63615f, f057af38500b4c10a76f31f602b53898; no voters:
I20260806 20:34:33.811586 3029 raft_consensus.cc:2781] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:34:33.811748 3029 raft_consensus.cc:482] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:34:33.811851 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.799407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:53957 (local address 127.13.149.67:43025)
0806 20:34:33.799625 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.799633 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.802552 (+ 2919us) server_negotiation.cc:407] Connection header received
0806 20:34:33.802811 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.802816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.802887 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.802949 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:33.803851 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.804964 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.809199 (+ 4235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.810486 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.810632 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.810705 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.811456 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.811581 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 20:34:33.811865 3029 raft_consensus.cc:3037] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:33.813376 3045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.800102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43025 (local address 127.13.149.66:53957)
0806 20:34:33.802444 (+ 2342us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.802461 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.802655 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.803140 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.803146 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.803175 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:33.803623 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.803634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.805324 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.805329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.809035 (+ 3706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.809050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.811054 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.811060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.811238 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.811280 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.811411 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.811536 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2223,"mutex_wait_us":1,"thread_start_us":2044,"threads_started":1}
I20260806 20:34:33.814572 2908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "023d1c3f47a24217ac42a433a89190be" candidate_uuid: "c4739db607964021ac81a45cac63615f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3d58d3356b4404be32c7917b099b8f" is_pre_election: true
I20260806 20:34:33.815001 2908 raft_consensus.cc:2454] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4739db607964021ac81a45cac63615f in term 0.
I20260806 20:34:33.815130 3029 raft_consensus.cc:504] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.816102 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.803843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:40623 (local address 127.13.149.66:41109)
0806 20:34:33.805184 (+ 1341us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.805189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.807969 (+ 2780us) server_negotiation.cc:407] Connection header received
0806 20:34:33.808225 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.808230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.808323 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.808395 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:33.809689 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.810669 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.813447 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.814952 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.815131 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.815201 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.815730 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.815885 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1217}
I20260806 20:34:33.816262 2443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "023d1c3f47a24217ac42a433a89190be" candidate_uuid: "c4739db607964021ac81a45cac63615f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f057af38500b4c10a76f31f602b53898"
I20260806 20:34:33.816499 2984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.802533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:44895 (local address 127.13.149.67:45789)
0806 20:34:33.802865 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.802883 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.802958 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.808672 (+ 5714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.808677 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.808712 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:33.809039 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.809050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.810960 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.810967 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.813207 (+ 2240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.813224 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.815770 (+ 2546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.815776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.815967 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.815997 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.816088 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.816216 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":81}
I20260806 20:34:33.816454 2443 raft_consensus.cc:3037] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:33.816633 2908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "023d1c3f47a24217ac42a433a89190be" candidate_uuid: "c4739db607964021ac81a45cac63615f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3d58d3356b4404be32c7917b099b8f"
I20260806 20:34:33.816851 2908 raft_consensus.cc:3037] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:33.816871 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.803163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:41109 (local address 127.13.149.67:40623)
0806 20:34:33.807884 (+ 4721us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:33.807902 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:33.808079 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:33.808608 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:33.808613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:33.808639 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:33.809501 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.809512 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.810834 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.810840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.813226 (+ 2386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:33.813235 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.815342 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.815348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:33.815545 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.815583 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 20:34:33.816242 (+ 659us) client_negotiation.cc:240] Negotiation successful
0806 20:34:33.816394 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4602,"mutex_wait_us":377,"thread_start_us":4424,"threads_started":1}
I20260806 20:34:33.817440 3046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.802725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:45789 (local address 127.13.149.65:44895)
0806 20:34:33.808320 (+ 5595us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.808325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.808344 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:34:33.808397 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.808401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.808470 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.809188 (+ 718us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:33.809525 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.810769 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.813403 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.815588 (+ 2185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.816817 (+ 1229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.816896 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.816950 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.817112 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5473,"thread_start_us":5271,"threads_started":1}
I20260806 20:34:33.817782 3029 leader_election.cc:288] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [CANDIDATE]: Term 1 election: Requested vote from peers ff3d58d3356b4404be32c7917b099b8f (127.13.149.67:43025), f057af38500b4c10a76f31f602b53898 (127.13.149.65:44895)
I20260806 20:34:33.818153 2683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "023d1c3f47a24217ac42a433a89190be" candidate_uuid: "ff3d58d3356b4404be32c7917b099b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4739db607964021ac81a45cac63615f" is_pre_election: true
I20260806 20:34:33.818598 2683 raft_consensus.cc:2379] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff3d58d3356b4404be32c7917b099b8f in current term 1: Already voted for candidate c4739db607964021ac81a45cac63615f in this term.
I20260806 20:34:33.818665 2442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "023d1c3f47a24217ac42a433a89190be" candidate_uuid: "ff3d58d3356b4404be32c7917b099b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f057af38500b4c10a76f31f602b53898" is_pre_election: true
I20260806 20:34:33.820062 2443 raft_consensus.cc:2454] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4739db607964021ac81a45cac63615f in term 1.
I20260806 20:34:33.819983 2806 leader_election.cc:302] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3d58d3356b4404be32c7917b099b8f; no voters: c4739db607964021ac81a45cac63615f, f057af38500b4c10a76f31f602b53898
I20260806 20:34:33.820447 2908 raft_consensus.cc:2454] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4739db607964021ac81a45cac63615f in term 1.
I20260806 20:34:33.820549 2567 leader_election.cc:302] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4739db607964021ac81a45cac63615f, f057af38500b4c10a76f31f602b53898; no voters:
I20260806 20:34:33.820669 3021 raft_consensus.cc:2726] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 20:34:33.820912 3029 raft_consensus.cc:2781] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:34:33.821380 3029 raft_consensus.cc:686] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 1 LEADER]: Becoming Leader. State: Replica: c4739db607964021ac81a45cac63615f, State: Running, Role: LEADER
I20260806 20:34:33.821929 3029 consensus_queue.cc:237] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } }
I20260806 20:34:33.826750 2205 catalog_manager.cc:5495] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f reported cstate change: term changed from 0 to 1, leader changed from <none> to c4739db607964021ac81a45cac63615f (127.13.149.66). New cstate: current_term: 1 leader_uuid: "c4739db607964021ac81a45cac63615f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4739db607964021ac81a45cac63615f" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 41109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 } health_report { overall_health: UNKNOWN } } }
W20260806 20:34:33.832245 2980 tablet.cc:2369] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:33.853998 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.848233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49146 (local address 127.13.149.66:41109)
0806 20:34:33.848582 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.848587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.848606 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:34:33.848763 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.848767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.848922 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.849048 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:34:33.849423 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.850304 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.851719 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.852252 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.852358 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.852949 (+ 591us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:34:33.853475 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:34:33.853597 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.853689 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.853753 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217}
I20260806 20:34:33.861773 2443 raft_consensus.cc:1261] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 1 FOLLOWER]: Refusing update from remote peer c4739db607964021ac81a45cac63615f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:33.861970 2908 raft_consensus.cc:1261] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 1 FOLLOWER]: Refusing update from remote peer c4739db607964021ac81a45cac63615f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:33.862700 3052 consensus_queue.cc:1035] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f057af38500b4c10a76f31f602b53898" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:34:33.863169 3029 consensus_queue.cc:1035] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3d58d3356b4404be32c7917b099b8f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:34:33.873515 3055 mvcc.cc:205] Tried to move back new op lower bound from 7315654548929089536 to 7315654548778532864. Current Snapshot: MvccSnapshot[applied={T|T < 7315654548929089536}]
I20260806 20:34:33.888492 2206 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:34:33.888828 2206 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:34:33.892318 2206 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f980d06dc0cd4df78ad17217affb51d9: Sending DeleteTablet for 3 replicas of tablet 023d1c3f47a24217ac42a433a89190be
I20260806 20:34:33.893648 2414 tablet_service.cc:1514] Processing DeleteTablet for tablet 023d1c3f47a24217ac42a433a89190be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:33 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:40916
I20260806 20:34:33.893932 2877 tablet_service.cc:1514] Processing DeleteTablet for tablet 023d1c3f47a24217ac42a433a89190be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:33 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:34632
I20260806 20:34:33.893937 2647 tablet_service.cc:1514] Processing DeleteTablet for tablet 023d1c3f47a24217ac42a433a89190be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:33 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:49134
I20260806 20:34:33.898801 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 2274
I20260806 20:34:33.904896 3072 tablet_replica.cc:330] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: stopping tablet replica
I20260806 20:34:33.906185 3072 raft_consensus.cc:2229] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:34:33.907835 3072 raft_consensus.cc:2258] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:33.908773 3071 tablet_replica.cc:330] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: stopping tablet replica
I20260806 20:34:33.909674 3071 raft_consensus.cc:2229] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:34:33.912281 3072 ts_tablet_manager.cc:1905] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:33.913621 3071 raft_consensus.cc:2258] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:33.914471 3069 tablet_replica.cc:330] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: stopping tablet replica
I20260806 20:34:33.914842 3069 raft_consensus.cc:2229] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:34:33.915285 3069 raft_consensus.cc:2258] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:33.917459 3069 ts_tablet_manager.cc:1905] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:33.918049 3071 ts_tablet_manager.cc:1905] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:33.922508 3072 ts_tablet_manager.cc:1918] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:33.922675 3072 log.cc:1196] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/023d1c3f47a24217ac42a433a89190be
I20260806 20:34:33.923245 3072 ts_tablet_manager.cc:1939] T 023d1c3f47a24217ac42a433a89190be P c4739db607964021ac81a45cac63615f: Deleting consensus metadata
I20260806 20:34:33.924769 3069 ts_tablet_manager.cc:1918] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:33.925062 3069 log.cc:1196] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/023d1c3f47a24217ac42a433a89190be
I20260806 20:34:33.925086 2186 catalog_manager.cc:4841] TS c4739db607964021ac81a45cac63615f (127.13.149.66:41109): tablet 023d1c3f47a24217ac42a433a89190be (table test-table [id=052cb567072842a2b0182da5749f1a46]) successfully deleted
I20260806 20:34:33.925576 3071 ts_tablet_manager.cc:1918] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:33.925745 3071 log.cc:1196] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/023d1c3f47a24217ac42a433a89190be
I20260806 20:34:33.925885 3069 ts_tablet_manager.cc:1939] T 023d1c3f47a24217ac42a433a89190be P f057af38500b4c10a76f31f602b53898: Deleting consensus metadata
I20260806 20:34:33.926349 3071 ts_tablet_manager.cc:1939] T 023d1c3f47a24217ac42a433a89190be P ff3d58d3356b4404be32c7917b099b8f: Deleting consensus metadata
I20260806 20:34:33.927887 2188 catalog_manager.cc:4841] TS f057af38500b4c10a76f31f602b53898 (127.13.149.65:44895): tablet 023d1c3f47a24217ac42a433a89190be (table test-table [id=052cb567072842a2b0182da5749f1a46]) successfully deleted
I20260806 20:34:33.928095 2186 catalog_manager.cc:4841] TS ff3d58d3356b4404be32c7917b099b8f (127.13.149.67:43025): tablet 023d1c3f47a24217ac42a433a89190be (table test-table [id=052cb567072842a2b0182da5749f1a46]) successfully deleted
I20260806 20:34:33.935765 3046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:33.901032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40928 (local address 127.13.149.65:44895)
0806 20:34:33.901304 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:33.901313 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:33.912929 (+ 11616us) server_negotiation.cc:407] Connection header received
0806 20:34:33.913093 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:33.913101 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:33.913213 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:33.913363 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:33.917461 (+ 4098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.918529 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.920414 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:33.921101 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:33.921232 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:33.928530 (+ 7298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:33.928545 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:33.928580 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:33.928624 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:33.932436 (+ 3812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.933389 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.933401 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.933404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.933586 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:33.934019 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:33.934025 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:33.934029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:33.934494 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:33.934812 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:33.935158 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 20:34:33.935407 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 20:34:33.936561 2507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:34.028638 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 2274
I20260806 20:34:34.063316 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 2522
I20260806 20:34:34.080170 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:34.064148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49150 (local address 127.13.149.66:41109)
0806 20:34:34.064389 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:34.064394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:34.064413 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:34:34.064627 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:34.064631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:34.064704 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:34.064848 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:34.066628 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:34.067405 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:34.069378 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:34.069899 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:34.069999 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:34.073801 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:34.073814 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:34.073830 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:34.073883 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:34.077173 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:34.078106 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:34.078113 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:34.078116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:34.078238 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:34.078711 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:34.078715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:34.078717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:34.079127 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:34.079388 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:34.079717 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 20:34:34.079901 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 20:34:34.080940 2746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:34.195156 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 2522
I20260806 20:34:34.220342 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 2762
I20260806 20:34:34.233361 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:34.221196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34646 (local address 127.13.149.67:43025)
0806 20:34:34.221387 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:34.221391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:34.221409 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:34:34.221561 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:34.221565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:34.221650 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:34.221731 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:34.222972 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:34.223688 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:34.225127 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:34.225504 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:34.225599 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:34.228099 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:34.228113 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:34.228128 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:34.228158 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:34.230887 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:34.231471 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:34.231477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:34.231479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:34.231597 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:34.231905 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:34.231908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:34.231910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:34.232239 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:34.232512 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:34.232718 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 20:34:34.233055 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:34:34.233943 2966 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:34.330291 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 2762
I20260806 20:34:34.356448 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 2161
I20260806 20:34:34.357841 2256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:34.469487 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 2161
I20260806 20:34:34.504490 13909 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 20:34:34.850126 13909 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 20:34:34.850389 13909 mini_ranger.cc:66] Stopping Ranger...
I20260806 20:34:35.195914 13909 mini_ranger.cc:68] Stopped Ranger
2026-08-06 20:34:35.196 UTC [680] LOG: received smart shutdown request
2026-08-06 20:34:35.199 UTC [680] LOG: background worker "logical replication launcher" (PID 694) exited with exit code 1
2026-08-06 20:34:35.200 UTC [684] LOG: shutting down
2026-08-06 20:34:35.355 UTC [680] LOG: database system is shut down
2026-08-06T20:34:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54465 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:34:35 dist-test-slave-2kcd krb5kdc[3092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:34:35 dist-test-slave-2kcd krb5kdc[3092](info): set up 2 sockets
Aug 06 20:34:35 dist-test-slave-2kcd krb5kdc[3092](info): commencing operation
krb5kdc: starting...
W20260806 20:34:36.816427 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:34:36 dist-test-slave-2kcd krb5kdc[3092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:34:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:34:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:34:37.091944 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:36011
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:36011,127.13.149.125:37555,127.13.149.124:35841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:37.435642 3112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:37.435927 3112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:37.436087 3112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:37.443320 3112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:37.443423 3112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:37.443540 3112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:37.443642 3112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:37.443722 3112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:37.453734 3112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:36011,127.13.149.125:37555,127.13.149.124:35841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:36011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:37.455040 3112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:37.456457 3112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:37.468699 3129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:37.468741 3125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:37.468684 3126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:37.469803 3112 server_base.cc:1034] running on GCE node
I20260806 20:34:37.470583 3112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:37.471923 3112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:37.473147 3112 hybrid_clock.cc:648] HybridClock initialized: now 1786048477473109 us; error 59 us; skew 500 ppm
I20260806 20:34:37.473519 3112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:37 dist-test-slave-2kcd krb5kdc[3092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:37.476764 3112 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:34:37.478358 3112 webserver.cc:460] Webserver started at http://127.13.149.126:33611/ using document root <none> and password file <none>
I20260806 20:34:37.479060 3112 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:37.479208 3112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:37.479543 3112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:37.482654 3112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "6cf6306aabe54ab7a490d03a362f6500"
format_stamp: "Formatted at 2026-08-06 20:34:37 on dist-test-slave-2kcd"
server_key: "4c132823dba8e9dae9f7eaf4caa08af7"
server_key_iv: "963e4d6355ade897c0946b998608b861"
server_key_version: "encryptionkey@0"
I20260806 20:34:37.483474 3112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "6cf6306aabe54ab7a490d03a362f6500"
format_stamp: "Formatted at 2026-08-06 20:34:37 on dist-test-slave-2kcd"
server_key: "4c132823dba8e9dae9f7eaf4caa08af7"
server_key_iv: "963e4d6355ade897c0946b998608b861"
server_key_version: "encryptionkey@0"
I20260806 20:34:37.488770 3112 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 20:34:37.492129 3143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:37.493418 3112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:34:37.493615 3112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "6cf6306aabe54ab7a490d03a362f6500"
format_stamp: "Formatted at 2026-08-06 20:34:37 on dist-test-slave-2kcd"
server_key: "4c132823dba8e9dae9f7eaf4caa08af7"
server_key_iv: "963e4d6355ade897c0946b998608b861"
server_key_version: "encryptionkey@0"
I20260806 20:34:37.493836 3112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:37.529330 3112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:37.533591 3112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:37.533921 3112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:37.553263 3112 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:36011
I20260806 20:34:37.553316 3232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:36011 every 8 connection(s)
I20260806 20:34:37.554677 3112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:34:37.557821 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 3112
I20260806 20:34:37.558080 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:34:37.558772 3233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:37.558938 13909 external_mini_cluster.cc:1428] Setting key 66390209f182c3f0c3ddc0dee08aa0dd
I20260806 20:34:37.568774 3233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:34:37 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.149.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.125@KRBTEST.COM" created.
I20260806 20:34:37.593968 3240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.572566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45910 (local address 127.13.149.126:36011)
0806 20:34:37.574505 (+ 1939us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:37.574512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:37.574552 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:34:37.576884 (+ 2332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:37.576890 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:37.577129 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:37.577295 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:37.579067 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:37.580284 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:37.581913 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:37.582473 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:37.582690 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:37.586678 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:37.586686 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:37.586699 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:37.586732 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:37.589752 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:37.590492 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:37.590498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:37.590500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:37.590657 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:37.591145 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:37.591148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:37.591150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:37.591667 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:37.591903 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:37.592523 (+ 620us) server_negotiation.cc:299] Negotiation successful
0806 20:34:37.592867 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1755,"spinlock_wait_cycles":40320,"thread_start_us":1523,"threads_started":1}
I20260806 20:34:37.594009 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.572567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:36011 (local address 127.0.0.1:45910)
0806 20:34:37.573512 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.573566 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:37.576431 (+ 2865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:37.577390 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:37.577400 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:37.578236 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:37.578752 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:37.578778 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:37.580452 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:37.580460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:37.581762 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:37.581775 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:37.582725 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:37.582732 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:37.582903 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:37.583694 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:37.583718 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:37.586415 (+ 2697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:37.589939 (+ 3524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:37.589954 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:37.589965 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:37.590364 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:37.590771 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:37.590774 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:37.590776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:37.591027 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:37.591834 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:37.591878 (+ 44us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:37.592075 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 20:34:37.592379 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 20:34:37.593043 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":106,"thread_start_us":456,"threads_started":1}
I20260806 20:34:37.597054 3233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:34:37.598470 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.597942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49762)
0806 20:34:37.598164 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.598305 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 20:34:37.598789 3144 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
I20260806 20:34:37.600525 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.600089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49774)
0806 20:34:37.600269 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.600362 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 20:34:37.600726 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:37555: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab.
Entry for principal kudu/127.13.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab.
I20260806 20:34:37.624559 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:37555
--webserver_interface=127.13.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab
--principal=kudu/127.13.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:36011,127.13.149.125:37555,127.13.149.124:35841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:34:37.650198 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } attempt: 1
I20260806 20:34:37.651480 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.650977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49786)
0806 20:34:37.651193 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.651323 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 20:34:37.652546 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.652198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49790)
0806 20:34:37.652356 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.652424 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:34:37.652737 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:37555: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
I20260806 20:34:37.721046 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } attempt: 2
I20260806 20:34:37.722373 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.721857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49792)
0806 20:34:37.722116 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.722222 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 20:34:37.723477 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.723082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49800)
0806 20:34:37.723267 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.723333 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 20:34:37.723668 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:37555: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
I20260806 20:34:37.814951 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } attempt: 3
I20260806 20:34:37.816211 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.815753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49806)
0806 20:34:37.815963 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.816078 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 20:34:37.817387 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.817029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49820)
0806 20:34:37.817190 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.817253 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 20:34:37.817581 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:37555: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
W20260806 20:34:37.959987 3245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:37.960327 3245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:37.960490 3245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 20:34:37.960870 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } attempt: 4
I20260806 20:34:37.962071 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.961504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49830)
0806 20:34:37.961839 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.961931 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260806 20:34:37.963126 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:37.962767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49846)
0806 20:34:37.962912 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:37.963008 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 20:34:37.963305 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:37555: Network error: Client connection negotiation failed: client connection to 127.13.149.125:37555: connect: Connection refused (error 111)
W20260806 20:34:37.968281 3245 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:37.968417 3245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:37.968515 3245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:37.968647 3245 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:37.968724 3245 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:37.978623 3245 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:36011,127.13.149.125:37555,127.13.149.124:35841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab
--principal=kudu/127.13.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:37555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:37.979986 3245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:37.981351 3245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:37.993690 3251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:37.993777 3250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:37.993777 3255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:37.994709 3245 server_base.cc:1034] running on GCE node
I20260806 20:34:37.995437 3245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:37.996760 3245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:37.998056 3245 hybrid_clock.cc:648] HybridClock initialized: now 1786048477997976 us; error 52 us; skew 500 ppm
I20260806 20:34:37.998407 3245 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:37 dist-test-slave-2kcd krb5kdc[3092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:38.001551 3245 init.cc:377] Logged in from keytab as kudu/127.13.149.125@KRBTEST.COM (short username kudu)
I20260806 20:34:38.003018 3245 webserver.cc:460] Webserver started at http://127.13.149.125:36249/ using document root <none> and password file <none>
I20260806 20:34:38.003700 3245 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:38.003847 3245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:38.004166 3245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:38.007181 3245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data/instance:
uuid: "e9afce9223f541a3b2c979d8ca5f4a96"
format_stamp: "Formatted at 2026-08-06 20:34:37 on dist-test-slave-2kcd"
server_key: "dc2a44916e7311844c6db89812fd6bbb"
server_key_iv: "ce9b9c670e2d9ef90511c87aad553020"
server_key_version: "encryptionkey@0"
I20260806 20:34:38.007992 3245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/wal/instance:
uuid: "e9afce9223f541a3b2c979d8ca5f4a96"
format_stamp: "Formatted at 2026-08-06 20:34:37 on dist-test-slave-2kcd"
server_key: "dc2a44916e7311844c6db89812fd6bbb"
server_key_iv: "ce9b9c670e2d9ef90511c87aad553020"
server_key_version: "encryptionkey@0"
I20260806 20:34:38.013269 3245 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:34:38.016686 3268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:38.018034 3245 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:34:38.018213 3245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/wal
uuid: "e9afce9223f541a3b2c979d8ca5f4a96"
format_stamp: "Formatted at 2026-08-06 20:34:37 on dist-test-slave-2kcd"
server_key: "dc2a44916e7311844c6db89812fd6bbb"
server_key_iv: "ce9b9c670e2d9ef90511c87aad553020"
server_key_version: "encryptionkey@0"
I20260806 20:34:38.018406 3245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:38.044507 3245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:38.049124 3245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:38.049431 3245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:38.068709 3245 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.125:37555
I20260806 20:34:38.068764 3346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.125:37555 every 8 connection(s)
I20260806 20:34:38.070711 3245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
I20260806 20:34:38.073515 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 3245
I20260806 20:34:38.073729 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-1/wal/instance
I20260806 20:34:38.074199 13909 external_mini_cluster.cc:1428] Setting key f6006ebb44593bae664792b238d74191
I20260806 20:34:38.074985 3347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:38.081545 3347 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.149.124@KRBTEST.COM; defaulting to no policy
I20260806 20:34:38.103091 3240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.084150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45914 (local address 127.13.149.126:36011)
0806 20:34:38.084335 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.084341 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.085951 (+ 1610us) server_negotiation.cc:407] Connection header received
0806 20:34:38.087788 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.087797 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.087903 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.088037 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.089563 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.090729 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.092251 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.093055 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.093204 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.096868 (+ 3664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.096874 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.096877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.096912 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.099875 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.100656 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.100669 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.100671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.100846 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.101321 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.101327 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.101331 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.101638 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.101804 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.102532 (+ 728us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.102766 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.124@KRBTEST.COM" created.
I20260806 20:34:38.104113 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.084776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:36011 (local address 127.0.0.1:45914)
0806 20:34:38.085703 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.085761 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.087493 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.088220 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.088227 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.088753 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.089375 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.089392 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.090895 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.090899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.092099 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.092111 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.093262 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.093267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.093458 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.094174 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.094196 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.096614 (+ 2418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.100044 (+ 3430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.100053 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.100070 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.100525 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.100957 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.100962 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.100966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.101199 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.101782 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.101790 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.102152 (+ 362us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.102416 (+ 264us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.102935 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":413,"threads_started":1}
I20260806 20:34:38.105903 3347 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:34:38.122705 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.106895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49848 (local address 127.13.149.125:37555)
0806 20:34:38.107604 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.107610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.107635 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:34:38.107682 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.107688 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.107852 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.107967 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.108996 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.110030 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.111804 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.112309 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.112402 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.116581 (+ 4179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.116593 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.116606 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.116635 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.119483 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.120326 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.120332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.120335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.120461 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.120995 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.120999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.121002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.121377 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.121626 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.122096 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.122346 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":430,"threads_started":1}
I20260806 20:34:38.122754 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.106674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49848)
0806 20:34:38.106883 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.106904 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.107020 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.108023 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.108031 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.108546 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.108812 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.108828 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.110184 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.110192 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.111663 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.111681 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.112463 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.112475 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.112729 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.113374 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.113401 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.116338 (+ 2937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.119635 (+ 3297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.119643 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.119650 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.120202 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.120571 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.120578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.120584 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.120770 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.121538 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.121546 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.121751 (+ 205us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.121937 (+ 186us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.122254 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 20:34:38.125365 3347 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:34:38.126586 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.126130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47292)
0806 20:34:38.126299 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.126445 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 20:34:38.126878 3274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
I20260806 20:34:38.128512 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.128168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47304)
0806 20:34:38.128343 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.128411 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 20:34:38.128762 3347 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab.
Entry for principal kudu/127.13.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab.
I20260806 20:34:38.140116 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:35841
--webserver_interface=127.13.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab
--principal=kudu/127.13.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:36011,127.13.149.125:37555,127.13.149.124:35841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:34:38.178122 3347 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 1
I20260806 20:34:38.179407 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.178807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47316)
0806 20:34:38.179058 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.179195 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260806 20:34:38.180506 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.180097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47326)
0806 20:34:38.180278 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.180376 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 20:34:38.180821 3347 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
I20260806 20:34:38.249065 3347 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 2
I20260806 20:34:38.250484 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.249808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47328)
0806 20:34:38.250122 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.250247 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 20:34:38.251827 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.251344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47334)
0806 20:34:38.251576 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.251670 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260806 20:34:38.253744 3347 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
I20260806 20:34:38.262557 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } attempt: 5
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:34:38.275645 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.263298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49862 (local address 127.13.149.125:37555)
0806 20:34:38.263515 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.263521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.263542 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:34:38.263719 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.263725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.263816 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.263923 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.264738 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.265484 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.266666 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.267146 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.267284 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.270412 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.270418 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.270430 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.270461 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.273100 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.273723 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.273735 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.273737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.273887 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.274280 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.274286 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.274290 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.274565 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.274722 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.275105 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.275314 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:34:38.275645 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.263192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49862)
0806 20:34:38.263389 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.263411 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.263547 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.263955 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.263960 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.264375 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.264578 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.264586 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.265626 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.265632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.266514 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.266524 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.267294 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.267300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.267485 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.268133 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.268151 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.270229 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.273242 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.273247 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.273251 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.273600 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.274010 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.274015 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.274019 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.274167 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.274686 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.274692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.274849 (+ 157us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.275012 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.275295 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 20:34:38.276922 3233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:34:38.277927 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.277554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47348)
0806 20:34:38.277716 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.277806 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 20:34:38.278870 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.278540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47350)
0806 20:34:38.278710 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.278771 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 20:34:38.279065 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
I20260806 20:34:38.330300 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 1
I20260806 20:34:38.331454 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.330986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47358)
0806 20:34:38.331189 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.331294 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 20:34:38.332473 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.332129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47362)
0806 20:34:38.332280 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.332342 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 20:34:38.332681 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
I20260806 20:34:38.345000 3347 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 3
I20260806 20:34:38.346019 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.345614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47374)
0806 20:34:38.345778 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.345857 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 20:34:38.347033 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.346608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47376)
0806 20:34:38.346822 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.346915 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260806 20:34:38.347226 3347 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
I20260806 20:34:38.400964 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 2
I20260806 20:34:38.402094 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.401625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47390)
0806 20:34:38.401830 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.401932 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 20:34:38.403110 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.402793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47394)
0806 20:34:38.402946 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.403014 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:34:38.403314 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
W20260806 20:34:38.479463 3361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:38.479841 3361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:38.479995 3361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:38.487140 3361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:38.487275 3361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:38.487378 3361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:38.487486 3361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:38.487572 3361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:38.490429 3347 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 4
I20260806 20:34:38.491547 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.491063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47400)
0806 20:34:38.491296 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.491382 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 20:34:38.492491 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.492174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47414)
0806 20:34:38.492313 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.492386 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 20:34:38.492698 3347 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
I20260806 20:34:38.497632 3361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:36011,127.13.149.125:37555,127.13.149.124:35841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab
--principal=kudu/127.13.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:35841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:38.498992 3361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:38.500286 3361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 20:34:38.509496 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 3
I20260806 20:34:38.510778 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.510120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47428)
0806 20:34:38.510446 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.510570 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260806 20:34:38.512141 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.511660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47444)
0806 20:34:38.511910 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.512003 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
W20260806 20:34:38.512084 3368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:38.512364 3367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:38.512436 3233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:35841: Network error: Client connection negotiation failed: client connection to 127.13.149.124:35841: connect: Connection refused (error 111)
W20260806 20:34:38.512673 3371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:38.513600 3361 server_base.cc:1034] running on GCE node
I20260806 20:34:38.514372 3361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:38.515692 3361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:38.516902 3361 hybrid_clock.cc:648] HybridClock initialized: now 1786048478516865 us; error 83 us; skew 500 ppm
I20260806 20:34:38.517349 3361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048478, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:38.525578 3361 init.cc:377] Logged in from keytab as kudu/127.13.149.124@KRBTEST.COM (short username kudu)
I20260806 20:34:38.527110 3361 webserver.cc:460] Webserver started at http://127.13.149.124:36933/ using document root <none> and password file <none>
I20260806 20:34:38.527783 3361 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:38.527884 3361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:38.528141 3361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:38.531177 3361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data/instance:
uuid: "0ecfc26108c043c6b3c866032953554a"
format_stamp: "Formatted at 2026-08-06 20:34:38 on dist-test-slave-2kcd"
server_key: "aab1050797b6321eb1f199c6aaf1f84c"
server_key_iv: "67aa6dbb7e77fb1986d0e949d523f7b4"
server_key_version: "encryptionkey@0"
I20260806 20:34:38.531932 3361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/wal/instance:
uuid: "0ecfc26108c043c6b3c866032953554a"
format_stamp: "Formatted at 2026-08-06 20:34:38 on dist-test-slave-2kcd"
server_key: "aab1050797b6321eb1f199c6aaf1f84c"
server_key_iv: "67aa6dbb7e77fb1986d0e949d523f7b4"
server_key_version: "encryptionkey@0"
I20260806 20:34:38.537230 3361 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:34:38.540624 3381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:38.542083 3361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:34:38.542220 3361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/wal
uuid: "0ecfc26108c043c6b3c866032953554a"
format_stamp: "Formatted at 2026-08-06 20:34:38 on dist-test-slave-2kcd"
server_key: "aab1050797b6321eb1f199c6aaf1f84c"
server_key_iv: "67aa6dbb7e77fb1986d0e949d523f7b4"
server_key_version: "encryptionkey@0"
I20260806 20:34:38.542382 3361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:38.560477 3361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:38.565093 3361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:38.565337 3361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:38.584148 3361 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.124:35841
I20260806 20:34:38.584193 3459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.124:35841 every 8 connection(s)
I20260806 20:34:38.585646 3361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
I20260806 20:34:38.587700 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 3361
I20260806 20:34:38.587920 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786048265930148-13909-0/minicluster-data/master-2/wal/instance
I20260806 20:34:38.588547 13909 external_mini_cluster.cc:1428] Setting key 809b2f2dbd9c18349bdbb3ec80dbd266
I20260806 20:34:38.590492 3462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:38.599416 3462 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048478, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:38.612588 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.590520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47452 (local address 127.13.149.124:35841)
0806 20:34:38.591380 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.591392 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.591433 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:34:38.593134 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.593154 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.593536 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.593854 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.595715 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.597176 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.599150 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.599802 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.599938 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.604861 (+ 4923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.604876 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.604886 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.604920 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.607921 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.608894 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.608901 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.608907 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.609086 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.609547 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.609550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.609552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.610038 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.610350 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.610888 (+ 538us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.611327 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":401,"threads_started":1}
I20260806 20:34:38.617169 3240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.602331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45916 (local address 127.13.149.126:36011)
0806 20:34:38.602579 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.602585 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.603311 (+ 726us) server_negotiation.cc:407] Connection header received
0806 20:34:38.603506 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.603514 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.603601 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.603709 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.604895 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.605595 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.607115 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.607566 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.607705 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.611201 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.611206 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.611209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.611241 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.614078 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.614795 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.614803 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.614807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.615038 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.615490 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.615495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.615498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.615874 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.616047 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.616606 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.616901 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 20:34:38.617317 3467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.602330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:36011 (local address 127.0.0.1:45916)
0806 20:34:38.603159 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.603208 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.603363 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.603805 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.603812 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.604385 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.604669 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.604682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.605787 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.605800 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.606957 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.606969 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.607770 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.607779 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.607956 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.608576 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.608609 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.610996 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.614223 (+ 3227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.614237 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.614248 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.614669 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.615158 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.615162 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.615164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.615346 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.616120 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.616134 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.616312 (+ 178us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.616469 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.616794 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":436,"threads_started":1}
I20260806 20:34:38.618932 3462 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048478, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:34:38.633968 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.619873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49872 (local address 127.13.149.125:37555)
0806 20:34:38.620053 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.620057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.620074 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:34:38.620208 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.620212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.620271 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.620347 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.621229 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.622285 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.623595 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.624326 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.624473 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.627344 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.627350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.627356 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.627402 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.630846 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.631662 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.631669 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.631672 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.631833 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.632312 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.632316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.632319 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.632665 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.632847 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.633361 (+ 514us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.633594 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:34:38.634001 3468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.615676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45932 (local address 127.13.149.126:36011)
0806 20:34:38.616330 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.616334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.616353 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:34:38.616391 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.616394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.616469 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.616583 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.618350 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.619451 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.621349 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.621982 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.622105 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.626959 (+ 4854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.626964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.626967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.626997 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.630638 (+ 3641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.631565 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.631569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.631571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.631739 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.632322 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.632328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.632331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.632682 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.632955 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.633361 (+ 406us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.633609 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":339,"threads_started":1}
I20260806 20:34:38.634016 3467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.619790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:37555 (local address 127.0.0.1:49872)
0806 20:34:38.619977 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.619997 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.620095 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.620410 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.620415 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.620881 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.621078 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.621089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.622418 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.622422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.623455 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.623467 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.624474 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.624478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.624624 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.625210 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.625227 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.627153 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.630999 (+ 3846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.631004 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.631008 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.631541 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.631975 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.631981 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.631988 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.632184 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.632894 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.632900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.633099 (+ 199us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.633266 (+ 167us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.633574 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 20:34:38.635174 3462 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048478, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:34:38.649550 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.635853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47466 (local address 127.13.149.124:35841)
0806 20:34:38.636143 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.636148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.636329 (+ 181us) server_negotiation.cc:407] Connection header received
0806 20:34:38.636496 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.636502 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.636570 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.636676 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.637440 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.638166 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.639331 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.639767 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.639928 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.643449 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.643455 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.643460 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.643495 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.646740 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.647477 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.647484 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.647487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.647619 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.648012 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.648019 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.648022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.648310 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.648469 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.648866 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.649118 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187}
I20260806 20:34:38.649634 3467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.635853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47466)
0806 20:34:38.636256 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.636272 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.636370 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.636692 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.636696 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.637153 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.637292 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.637301 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.638303 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.638310 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.639167 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.639179 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.639950 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.639956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.640137 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.640768 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.640851 (+ 83us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.643266 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.646853 (+ 3587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.646868 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.646872 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.647363 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.647742 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.647747 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.647750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.647902 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.648444 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.648448 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.648608 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.648764 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.649256 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":160}
I20260806 20:34:38.653066 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.635963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.13.149.125:37555)
0806 20:34:38.636143 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.636147 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.636262 (+ 115us) server_negotiation.cc:407] Connection header received
0806 20:34:38.636425 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.636430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.636496 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.636605 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.637915 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.638607 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.639816 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.640258 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.640392 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.645036 (+ 4644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.645044 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.645049 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.645093 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.648170 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.649108 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.649114 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.649118 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.649285 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.649754 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.649761 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.649766 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.650146 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.650454 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.650662 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.650904 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 20:34:38.655423 3462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: Bootstrap starting.
I20260806 20:34:38.658205 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:34:38.659161 3462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:38.660192 3462 log.cc:824] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:38.663069 3462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: No bootstrap required, opened a new log
I20260806 20:34:38.678520 3462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.679056 3462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:38.679167 3462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecfc26108c043c6b3c866032953554a, State: Initialized, Role: FOLLOWER
I20260806 20:34:38.680161 3462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.689666 3233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 4
I20260806 20:34:38.691638 3482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.692163 3482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:34:38.695125 3462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:38.695959 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.669038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47474 (local address 127.13.149.124:35841)
0806 20:34:38.669282 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.669290 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.675562 (+ 6272us) server_negotiation.cc:407] Connection header received
0806 20:34:38.676154 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.676164 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.676269 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.676361 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.679407 (+ 3046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.680530 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.683035 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.683732 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.683862 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.688116 (+ 4254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.688126 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.688133 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.688183 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.692254 (+ 4071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.693303 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.693311 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.693314 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.693509 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.693998 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.694003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.694006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.694395 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.694673 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.695314 (+ 641us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.695547 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
I20260806 20:34:38.710547 3468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.663093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45940 (local address 127.13.149.126:36011)
0806 20:34:38.663343 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.663349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.679347 (+ 15998us) server_negotiation.cc:407] Connection header received
0806 20:34:38.679811 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.679817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.679904 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.679977 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.682653 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.683740 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.686356 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.687119 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.687231 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.696096 (+ 8865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.696107 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.696115 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.696174 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.701093 (+ 4919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.702028 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.702034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.702037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.702189 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.702675 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.702681 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.702685 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.703078 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.703345 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.709828 (+ 6483us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.710099 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260806 20:34:38.712689 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.663464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49890 (local address 127.13.149.125:37555)
0806 20:34:38.663692 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.663701 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.681548 (+ 17847us) server_negotiation.cc:407] Connection header received
0806 20:34:38.681749 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.681760 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.681873 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.681991 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.685209 (+ 3218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.686715 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.690351 (+ 3636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.691161 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.691298 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.699484 (+ 8186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.699493 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.699498 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.699560 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.703265 (+ 3705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.704221 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.704228 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.704231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.704405 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.704933 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.704938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.704942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.705227 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.705393 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.712018 (+ 6625us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.712291 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 20:34:38.715030 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.690412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47484)
0806 20:34:38.690732 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.690754 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.690859 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.696567 (+ 5708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.696574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.697233 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.697542 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.697561 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.699486 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.699495 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.701861 (+ 2366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.701883 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.703206 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.703215 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.703493 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.704121 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.704153 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.707601 (+ 3448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.712114 (+ 4513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.712119 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.712122 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.712627 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.713126 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.713131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.713135 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.713315 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.714125 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.714133 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.714331 (+ 198us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.714431 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.714633 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20260806 20:34:38.716135 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.690460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47484 (local address 127.13.149.124:35841)
0806 20:34:38.696191 (+ 5731us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.696201 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.696219 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:34:38.696265 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.696270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.696344 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.697750 (+ 1406us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.697983 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.699279 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.702085 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.702988 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.703864 (+ 876us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.707928 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.707937 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.707944 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.707986 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.711944 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.712812 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.712819 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.712822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.712972 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.713488 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.713497 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.713503 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.713945 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.715376 (+ 1431us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.715530 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.715778 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5624,"thread_start_us":6096,"threads_started":1}
I20260806 20:34:38.723438 3233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500: Bootstrap starting.
I20260806 20:34:38.717255 3361 master_runner.cc:186] Error getting master registration for 127.13.149.126:36011: OK, instance_id { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" instance_seqno: 1786048477547763 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 20:34:38.726405 3361 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 20:34:38.727337 3497 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:34:38.727455 3497 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:34:38.727645 3233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:38.728986 3233 log.cc:824] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:38.732105 3233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500: No bootstrap required, opened a new log
I20260806 20:34:38.742882 3233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.743261 3233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:38.743389 3233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf6306aabe54ab7a490d03a362f6500, State: Initialized, Role: FOLLOWER
I20260806 20:34:38.744125 3233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.745121 3500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.745528 3500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:34:38.746464 3233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 20:34:38.757874 3518 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:34:38.757998 3518 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:34:38.757207 3112 master_runner.cc:186] Error getting master registration for 127.13.149.125:37555: OK, instance_id { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" instance_seqno: 1786048478063067 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 20:34:38.769443 3112 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 20:34:38.786902 3157 tablet.cc:2369] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:38.791977 3347 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } attempt: 5
I20260806 20:34:38.798301 3500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:34:38.798589 3500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.800222 3500 leader_election.cc:288] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9afce9223f541a3b2c979d8ca5f4a96 (127.13.149.125:37555), 0ecfc26108c043c6b3c866032953554a (127.13.149.124:35841)
I20260806 20:34:38.801945 3424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cf6306aabe54ab7a490d03a362f6500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecfc26108c043c6b3c866032953554a" is_pre_election: true
I20260806 20:34:38.802548 3424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf6306aabe54ab7a490d03a362f6500 in term 0.
Aug 06 20:34:38 dist-test-slave-2kcd krb5kdc[3092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048477, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
I20260806 20:34:38.803447 3151 leader_election.cc:302] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecfc26108c043c6b3c866032953554a, 6cf6306aabe54ab7a490d03a362f6500; no voters:
I20260806 20:34:38.804186 3500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:34:38.804340 3500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:34:38.804435 3500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:38.807888 3500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.809801 3424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cf6306aabe54ab7a490d03a362f6500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecfc26108c043c6b3c866032953554a"
I20260806 20:34:38.810002 3424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:38.811640 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.792663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:35841 (local address 127.0.0.1:47490)
0806 20:34:38.792958 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:38.792979 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:38.793094 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:38.793459 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:38.793465 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:38.794045 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:38.794259 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.794271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.795704 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.795712 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.797243 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:38.797259 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.799997 (+ 2738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.800003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:38.800230 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.801027 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:38.801056 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:38.804060 (+ 3004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:38.808496 (+ 4436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.808501 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.808505 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.809097 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.809573 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:38.809578 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:38.809581 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:38.809740 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:38.810615 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:38.810620 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:38.810816 (+ 196us) client_negotiation.cc:769] Sending connection context
0806 20:34:38.810971 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 20:34:38.811250 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260806 20:34:38.812762 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:38.792900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47490 (local address 127.13.149.124:35841)
0806 20:34:38.793075 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:38.793082 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:38.793110 (+ 28us) server_negotiation.cc:407] Connection header received
0806 20:34:38.793233 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:38.793238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:38.793311 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:38.793408 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:38.794416 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.795570 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.798942 (+ 3372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:38.799648 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:38.799787 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:38.804267 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:38.804274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:38.804279 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:38.804319 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:38.808323 (+ 4004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.809243 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.809250 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.809254 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.809415 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:38.809889 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:38.809894 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:38.809898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:38.810400 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:38.810550 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:38.812062 (+ 1512us) server_negotiation.cc:299] Negotiation successful
0806 20:34:38.812325 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 20:34:38.814378 3424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf6306aabe54ab7a490d03a362f6500 in term 1.
I20260806 20:34:38.814936 3151 leader_election.cc:302] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecfc26108c043c6b3c866032953554a, 6cf6306aabe54ab7a490d03a362f6500; no voters:
W20260806 20:34:38.817406 3393 tablet.cc:2369] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:38.820101 3347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: Bootstrap starting.
I20260806 20:34:38.820335 3500 leader_election.cc:288] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [CANDIDATE]: Term 1 election: Requested vote from peers e9afce9223f541a3b2c979d8ca5f4a96 (127.13.149.125:37555), 0ecfc26108c043c6b3c866032953554a (127.13.149.124:35841)
I20260806 20:34:38.821091 3500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:34:38.821684 3500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf6306aabe54ab7a490d03a362f6500, State: Running, Role: LEADER
I20260806 20:34:38.823896 3500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.827680 3347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:38.829135 3347 log.cc:824] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:38.842842 3520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cf6306aabe54ab7a490d03a362f6500. Latest consensus state: current_term: 1 leader_uuid: "6cf6306aabe54ab7a490d03a362f6500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.843338 3520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:38.844053 3347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: No bootstrap required, opened a new log
I20260806 20:34:38.855044 3525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:34:38.857746 3347 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.858179 3347 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:38.858305 3347 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9afce9223f541a3b2c979d8ca5f4a96, State: Initialized, Role: FOLLOWER
I20260806 20:34:38.859069 3347 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } }
I20260806 20:34:38.866901 3525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:34:38.873623 3526 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.874146 3526 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:34:38.874734 3347 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:38.874785 3305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cf6306aabe54ab7a490d03a362f6500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" is_pre_election: true
I20260806 20:34:38.875067 3304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cf6306aabe54ab7a490d03a362f6500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9afce9223f541a3b2c979d8ca5f4a96"
I20260806 20:34:38.878155 3305 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf6306aabe54ab7a490d03a362f6500 in term 0.
I20260806 20:34:38.889292 3304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:38.889340 3424 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [term 1 FOLLOWER]: Refusing update from remote peer 6cf6306aabe54ab7a490d03a362f6500: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:38.892233 3304 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [term 1 FOLLOWER]: Refusing update from remote peer 6cf6306aabe54ab7a490d03a362f6500: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:38.893131 3520 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:34:38.895200 3520 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 20:34:38.909866 3549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:34:38.910111 3549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:34:38.926133 3482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cf6306aabe54ab7a490d03a362f6500. Latest consensus state: current_term: 1 leader_uuid: "6cf6306aabe54ab7a490d03a362f6500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.926470 3482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:34:38.932840 3528 mvcc.cc:205] Tried to move back new op lower bound from 7315654569513885696 to 7315654569276841984. Current Snapshot: MvccSnapshot[applied={T|T < 7315654569513885696}]
I20260806 20:34:38.934584 3551 mvcc.cc:205] Tried to move back new op lower bound from 7315654569513885696 to 7315654569276841984. Current Snapshot: MvccSnapshot[applied={T|T < 7315654569513885696}]
I20260806 20:34:38.946184 3526 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cf6306aabe54ab7a490d03a362f6500. Latest consensus state: current_term: 1 leader_uuid: "6cf6306aabe54ab7a490d03a362f6500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.946550 3526 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:34:38.958712 3500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6cf6306aabe54ab7a490d03a362f6500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.959102 3500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:38.959559 3500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6cf6306aabe54ab7a490d03a362f6500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.959815 3500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:38.962903 3525 catalog_manager.cc:1347] Generated new cluster ID: d5c8ec553b6b4c07985a36c205d90a7a
I20260806 20:34:38.963011 3525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:34:38.963375 3482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6cf6306aabe54ab7a490d03a362f6500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.963640 3482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:34:38.980966 3526 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6cf6306aabe54ab7a490d03a362f6500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf6306aabe54ab7a490d03a362f6500" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36011 } } peers { permanent_uuid: "e9afce9223f541a3b2c979d8ca5f4a96" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 37555 } } peers { permanent_uuid: "0ecfc26108c043c6b3c866032953554a" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 35841 } } }
I20260806 20:34:38.981268 3526 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:34:39.007678 3525 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:34:39.009703 3525 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:34:39.035989 3525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cf6306aabe54ab7a490d03a362f6500: Generated new TSK 0
I20260806 20:34:39.037292 3525 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:34:39.729624 3497 catalog_manager.cc:1259] Loaded cluster ID: d5c8ec553b6b4c07985a36c205d90a7a
I20260806 20:34:39.729753 3497 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: loading cluster ID for follower catalog manager: success
I20260806 20:34:39.732331 3497 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: acquiring CA information for follower catalog manager: success
I20260806 20:34:39.734266 3497 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0ecfc26108c043c6b3c866032953554a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 20:34:39.912976 3549 catalog_manager.cc:1259] Loaded cluster ID: d5c8ec553b6b4c07985a36c205d90a7a
I20260806 20:34:39.913101 3549 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: loading cluster ID for follower catalog manager: success
I20260806 20:34:39.917326 3549 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: acquiring CA information for follower catalog manager: success
I20260806 20:34:39.920217 3549 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e9afce9223f541a3b2c979d8ca5f4a96: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 20:34:40.194304 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 3112
I20260806 20:34:40.195647 3225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:40.312530 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 3112
W20260806 20:34:40.345160 3385 connection.cc:535] server connection from 127.0.0.1:47484 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 20:34:40.345273 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 3245
I20260806 20:34:40.346547 3340 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:40.453706 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 3245
I20260806 20:34:40.482566 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 3361
I20260806 20:34:40.483713 3454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:40.594383 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 3361
2026-08-06T20:34:40Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5115 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:34:40 dist-test-slave-2kcd krb5kdc[3573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:34:40 dist-test-slave-2kcd krb5kdc[3573](info): set up 2 sockets
Aug 06 20:34:40 dist-test-slave-2kcd krb5kdc[3573](info): commencing operation
krb5kdc: starting...
W20260806 20:34:41.931216 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:34:42 dist-test-slave-2kcd krb5kdc[3573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:34:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:34:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:34:42.212270 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:37161
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:37161
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:42.572906 3592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:42.573243 3592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:42.573413 3592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:42.580721 3592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:42.580895 3592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:42.581022 3592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:42.581127 3592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:42.581205 3592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:42.591117 3592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:37161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:37161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:42.592540 3592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:42.594005 3592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:42.606175 3606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:42.606251 3603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:42.606211 3608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:42.607116 3592 server_base.cc:1034] running on GCE node
I20260806 20:34:42.607846 3592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:42.609282 3592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:42.610524 3592 hybrid_clock.cc:648] HybridClock initialized: now 1786048482610479 us; error 50 us; skew 500 ppm
I20260806 20:34:42.610872 3592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:42 dist-test-slave-2kcd krb5kdc[3573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048482, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:42.614017 3592 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:34:42.615360 3592 webserver.cc:460] Webserver started at http://127.13.149.126:41853/ using document root <none> and password file <none>
I20260806 20:34:42.615980 3592 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:42.616080 3592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:42.616331 3592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:42.619232 3592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d"
format_stamp: "Formatted at 2026-08-06 20:34:42 on dist-test-slave-2kcd"
server_key: "ea5ae8a7fdc3cb7fa8e3e4af1beb10a5"
server_key_iv: "4503dca28cc113e5b78b09c57e741fbd"
server_key_version: "encryptionkey@0"
I20260806 20:34:42.619917 3592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d"
format_stamp: "Formatted at 2026-08-06 20:34:42 on dist-test-slave-2kcd"
server_key: "ea5ae8a7fdc3cb7fa8e3e4af1beb10a5"
server_key_iv: "4503dca28cc113e5b78b09c57e741fbd"
server_key_version: "encryptionkey@0"
I20260806 20:34:42.624905 3592 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:34:42.628191 3618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:42.629518 3592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 20:34:42.629689 3592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d"
format_stamp: "Formatted at 2026-08-06 20:34:42 on dist-test-slave-2kcd"
server_key: "ea5ae8a7fdc3cb7fa8e3e4af1beb10a5"
server_key_iv: "4503dca28cc113e5b78b09c57e741fbd"
server_key_version: "encryptionkey@0"
I20260806 20:34:42.629887 3592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:42.649014 3592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:42.653003 3592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:42.653317 3592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:42.672570 3592 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:37161
I20260806 20:34:42.672601 3693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:37161 every 8 connection(s)
I20260806 20:34:42.674010 3592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:34:42.678126 3695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:42.684051 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 3592
I20260806 20:34:42.684299 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:34:42.685046 13909 external_mini_cluster.cc:1428] Setting key c070c28dd7e9e15582c9ce8531c13a8f
I20260806 20:34:42.691057 3695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d: Bootstrap starting.
I20260806 20:34:42.695189 3695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:42.696447 3695 log.cc:824] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:42.699822 3695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d: No bootstrap required, opened a new log
Aug 06 20:34:42 dist-test-slave-2kcd krb5kdc[3573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:42.710397 3695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37161 } }
I20260806 20:34:42.710861 3695 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:42.711005 3695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d, State: Initialized, Role: FOLLOWER
I20260806 20:34:42.711519 3698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:42.686968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49084 (local address 127.13.149.126:37161)
0806 20:34:42.688263 (+ 1295us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:42.688281 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:42.688336 (+ 55us) server_negotiation.cc:407] Connection header received
0806 20:34:42.691079 (+ 2743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:42.691111 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:42.691599 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:42.692057 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:42.693582 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:42.695680 (+ 2098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:42.697325 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:42.698289 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:42.698486 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:42.703365 (+ 4879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:42.703373 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:42.703388 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:42.703437 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:42.706741 (+ 3304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:42.707746 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:42.707754 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:42.707760 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:42.707969 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:42.708449 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:42.708452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:42.708454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:42.709131 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:42.709356 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:42.709891 (+ 535us) server_negotiation.cc:299] Negotiation successful
0806 20:34:42.710226 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":940,"thread_start_us":582,"threads_started":1}
I20260806 20:34:42.711771 3695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37161 } }
I20260806 20:34:42.712109 3695 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:34:42.712299 3695 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:34:42.712524 3695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:42.715513 3695 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37161 } }
I20260806 20:34:42.715613 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:34:42.716061 3695 leader_election.cc:302] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d; no voters:
I20260806 20:34:42.716853 3695 leader_election.cc:288] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:34:42.716998 3705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:34:42.719578 3695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:42.721079 3705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [term 1 LEADER]: Becoming Leader. State: Replica: 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d, State: Running, Role: LEADER
I20260806 20:34:42.721897 3705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37161 } }
I20260806 20:34:42.725093 3707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37161 } } }
I20260806 20:34:42.725481 3707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:42.726037 3708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d. Latest consensus state: current_term: 1 leader_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e30d4d2f4ea4ab7bf8b4ce72b1cac6d" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 37161 } } }
I20260806 20:34:42.726356 3708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:42.728055 3717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:34:42.732524 3717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:34:42.741515 3717 catalog_manager.cc:1347] Generated new cluster ID: c8698918dba44b89a8cb6457f61e6f55
I20260806 20:34:42.741642 3717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:34:42.764568 3717 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:34:42.765969 3717 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:34:42.775612 3717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e30d4d2f4ea4ab7bf8b4ce72b1cac6d: Generated new TSK 0
I20260806 20:34:42.776491 3717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:34:42.828272 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 3592
I20260806 20:34:42.829453 3687 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:42.926182 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 3592
2026-08-06T20:34:42Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2333 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:34:43 dist-test-slave-2kcd krb5kdc[3737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:34:43 dist-test-slave-2kcd krb5kdc[3737](info): set up 2 sockets
Aug 06 20:34:43 dist-test-slave-2kcd krb5kdc[3737](info): commencing operation
krb5kdc: starting...
W20260806 20:34:44.279958 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:34:44 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:34:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:34:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:34:44.570060 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35397
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:35397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:44.918211 3757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:44.918514 3757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:44.918603 3757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:44.925864 3757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:44.925994 3757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:44.926051 3757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:44.926105 3757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:44.926149 3757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:44.936461 3757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:35397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:44.938031 3757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:44.939380 3757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:44.951627 3763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:44.951738 3764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:44.951711 3768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:44.952900 3757 server_base.cc:1034] running on GCE node
I20260806 20:34:44.953821 3757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:44.955430 3757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:44.956684 3757 hybrid_clock.cc:648] HybridClock initialized: now 1786048484956622 us; error 51 us; skew 500 ppm
I20260806 20:34:44.957082 3757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:44 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048484, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:44.966977 3757 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:34:44.968875 3757 webserver.cc:460] Webserver started at http://127.13.149.126:43875/ using document root <none> and password file <none>
I20260806 20:34:44.969645 3757 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:44.969789 3757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:44.970130 3757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:44.973403 3757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "cefb87e53028472fbdac79a6762b5114"
format_stamp: "Formatted at 2026-08-06 20:34:44 on dist-test-slave-2kcd"
server_key: "e7ef320296fb05e5038bc660fff80269"
server_key_iv: "9e1b46ab696462f4ae829c9f84a9ef41"
server_key_version: "encryptionkey@0"
I20260806 20:34:44.974247 3757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "cefb87e53028472fbdac79a6762b5114"
format_stamp: "Formatted at 2026-08-06 20:34:44 on dist-test-slave-2kcd"
server_key: "e7ef320296fb05e5038bc660fff80269"
server_key_iv: "9e1b46ab696462f4ae829c9f84a9ef41"
server_key_version: "encryptionkey@0"
I20260806 20:34:44.979873 3757 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260806 20:34:44.983520 3778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:44.985070 3757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:34:44.985253 3757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "cefb87e53028472fbdac79a6762b5114"
format_stamp: "Formatted at 2026-08-06 20:34:44 on dist-test-slave-2kcd"
server_key: "e7ef320296fb05e5038bc660fff80269"
server_key_iv: "9e1b46ab696462f4ae829c9f84a9ef41"
server_key_version: "encryptionkey@0"
I20260806 20:34:44.985452 3757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:45.004526 3757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:45.009470 3757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:45.009807 3757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:45.029505 3757 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:35397
I20260806 20:34:45.029511 3856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:35397 every 8 connection(s)
I20260806 20:34:45.030980 3757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:34:45.035138 3857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:45.039942 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 3757
I20260806 20:34:45.040180 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:34:45.040932 13909 external_mini_cluster.cc:1428] Setting key cdc51828bcd12fcf29a1ec4ad5d22843
I20260806 20:34:45.046336 3857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Bootstrap starting.
I20260806 20:34:45.050101 3857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:45.051460 3857 log.cc:824] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:45.054993 3857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: No bootstrap required, opened a new log
Aug 06 20:34:45 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:45.063621 3857 raft_consensus.cc:348] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:45.064083 3857 raft_consensus.cc:374] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:45.064217 3857 raft_consensus.cc:729] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefb87e53028472fbdac79a6762b5114, State: Initialized, Role: FOLLOWER
I20260806 20:34:45.064978 3857 consensus_queue.cc:260] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:45.065264 3857 raft_consensus.cc:388] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:34:45.065459 3857 raft_consensus.cc:482] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:34:45.065662 3857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:45.067054 3861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:45.043046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.13.149.126:35397)
0806 20:34:45.044110 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:45.044122 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:45.044162 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:34:45.046120 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:45.046143 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:45.046576 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:45.046900 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:45.048900 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:45.050183 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:45.052252 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:45.053262 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:45.053400 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:45.058436 (+ 5036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:45.058445 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:45.058460 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:45.058499 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:45.061793 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:45.062779 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:45.062788 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:45.062813 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:45.063035 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:45.063477 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:45.063482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:45.063485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:45.064238 (+ 753us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:45.064546 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:45.065144 (+ 598us) server_negotiation.cc:299] Negotiation successful
0806 20:34:45.065614 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":822,"thread_start_us":538,"threads_started":1}
I20260806 20:34:45.069058 3857 raft_consensus.cc:504] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:45.069567 3857 leader_election.cc:302] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cefb87e53028472fbdac79a6762b5114; no voters:
I20260806 20:34:45.070281 3857 leader_election.cc:288] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:34:45.070407 3866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:34:45.071143 3866 raft_consensus.cc:686] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 LEADER]: Becoming Leader. State: Replica: cefb87e53028472fbdac79a6762b5114, State: Running, Role: LEADER
I20260806 20:34:45.071718 3866 consensus_queue.cc:237] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:45.072525 3857 sys_catalog.cc:564] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:45.074887 3874 sys_catalog.cc:455] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cefb87e53028472fbdac79a6762b5114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } } }
I20260806 20:34:45.075358 3874 sys_catalog.cc:458] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:45.075105 3871 sys_catalog.cc:455] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cefb87e53028472fbdac79a6762b5114. Latest consensus state: current_term: 1 leader_uuid: "cefb87e53028472fbdac79a6762b5114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } } }
I20260806 20:34:45.075578 3871 sys_catalog.cc:458] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:45.076205 3882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:34:45.084543 3882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:34:45.094204 3882 catalog_manager.cc:1347] Generated new cluster ID: 85c2d49eaf894862a567706d9d94b88b
I20260806 20:34:45.094343 3882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:34:45.107687 3882 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:34:45.109099 3882 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:34:45.121025 3882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Generated new TSK 0
I20260806 20:34:45.121932 3882 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:34:45.201349 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35397
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:45.548437 3910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:45.548714 3910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:45.548875 3910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:45.556005 3910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:45.556105 3910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:45.556218 3910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:34:45.565918 3910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:45.567262 3910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:45.568819 3910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:45.582655 3918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:45.582602 3923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:45.582690 3920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:45.583495 3910 server_base.cc:1034] running on GCE node
I20260806 20:34:45.584141 3910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:45.585278 3910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:45.586539 3910 hybrid_clock.cc:648] HybridClock initialized: now 1786048485586476 us; error 55 us; skew 500 ppm
I20260806 20:34:45.586897 3910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:45 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048485, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:45.590438 3910 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:34:45.591941 3910 webserver.cc:460] Webserver started at http://127.13.149.65:34653/ using document root <none> and password file <none>
I20260806 20:34:45.592654 3910 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:45.592876 3910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:45.593209 3910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:45.596256 3910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
format_stamp: "Formatted at 2026-08-06 20:34:45 on dist-test-slave-2kcd"
server_key: "794ebe482e290a24b8fb0218623b462d"
server_key_iv: "f04991092ab81a54ea488f3f309bea29"
server_key_version: "encryptionkey@0"
I20260806 20:34:45.597129 3910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
format_stamp: "Formatted at 2026-08-06 20:34:45 on dist-test-slave-2kcd"
server_key: "794ebe482e290a24b8fb0218623b462d"
server_key_iv: "f04991092ab81a54ea488f3f309bea29"
server_key_version: "encryptionkey@0"
I20260806 20:34:45.602766 3910 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:34:45.606526 3933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:45.607961 3910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:34:45.608292 3910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
format_stamp: "Formatted at 2026-08-06 20:34:45 on dist-test-slave-2kcd"
server_key: "794ebe482e290a24b8fb0218623b462d"
server_key_iv: "f04991092ab81a54ea488f3f309bea29"
server_key_version: "encryptionkey@0"
I20260806 20:34:45.608538 3910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:45.628772 3910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:45.632839 3910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:45.633145 3910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:45.634168 3910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:45.635670 3910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:45.635775 3910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:45.635933 3910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:45.636006 3910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:45.670172 3910 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:40649
I20260806 20:34:45.670284 4092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:40649 every 8 connection(s)
I20260806 20:34:45.671517 3910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:34:45.680702 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 3910
I20260806 20:34:45.680992 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:34:45.681736 13909 external_mini_cluster.cc:1428] Setting key 536494620403200e92d1283248116c07
Aug 06 20:34:45 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048485, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:45.693334 4095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:45.674509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:59879 (local address 127.13.149.126:35397)
0806 20:34:45.675062 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:45.675066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:45.675741 (+ 675us) server_negotiation.cc:407] Connection header received
0806 20:34:45.677677 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:45.677682 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:45.677761 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:45.677893 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:45.679282 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:45.680048 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:45.681731 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:45.682341 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:45.682501 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:45.686203 (+ 3702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:45.686212 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:45.686220 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:45.686268 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:45.689873 (+ 3605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:45.690708 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:45.690717 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:45.690724 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:45.690882 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:45.691308 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:45.691315 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:45.691321 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:45.691707 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:45.691882 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:45.692561 (+ 679us) server_negotiation.cc:299] Negotiation successful
0806 20:34:45.692844 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":274,"threads_started":1}
I20260806 20:34:45.693953 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:45.674696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:59879)
0806 20:34:45.675585 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:45.675630 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:45.677409 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:45.678077 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:45.678085 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:45.678584 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:45.679130 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:45.679147 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:45.680191 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:45.680195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:45.681569 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:45.681582 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:45.682625 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:45.682636 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:45.682872 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:45.683570 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:45.683591 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:45.685962 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:45.690018 (+ 4056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:45.690059 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:45.690077 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:45.690577 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:45.690996 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:45.690999 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:45.691002 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:45.691190 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:45.691839 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:45.691845 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:45.692147 (+ 302us) client_negotiation.cc:769] Sending connection context
0806 20:34:45.692395 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 20:34:45.692853 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":412,"threads_started":1}
I20260806 20:34:45.695502 4093 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35397
I20260806 20:34:45.695840 4093 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:45.696758 4093 heartbeater.cc:511] Master 127.13.149.126:35397 requested a full tablet report, sending...
I20260806 20:34:45.699164 3811 ts_manager.cc:194] Registered new tserver with Master: b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649)
I20260806 20:34:45.701401 3811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:59879
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:34:45.748811 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35397
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:46.099655 4106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:46.100203 4106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:46.100396 4106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:46.108712 4106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:46.108908 4106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:46.109119 4106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:34:46.119410 4106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:46.120934 4106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:46.122332 4106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:46.135836 4114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:46.135859 4118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:46.136108 4115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:46.137131 4106 server_base.cc:1034] running on GCE node
I20260806 20:34:46.137871 4106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:46.138888 4106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:46.140136 4106 hybrid_clock.cc:648] HybridClock initialized: now 1786048486140094 us; error 53 us; skew 500 ppm
I20260806 20:34:46.140486 4106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:46 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048486, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:46.143759 4106 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:34:46.145323 4106 webserver.cc:460] Webserver started at http://127.13.149.66:45969/ using document root <none> and password file <none>
I20260806 20:34:46.146047 4106 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:46.146206 4106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:46.146541 4106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:46.149744 4106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "4595084996934db4bc43a472f6a6c6fa"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "b09975ea11b9b9c8283e790a06146212"
server_key_iv: "88e6673f3260fb989d1089a2a7f212eb"
server_key_version: "encryptionkey@0"
I20260806 20:34:46.150604 4106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "4595084996934db4bc43a472f6a6c6fa"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "b09975ea11b9b9c8283e790a06146212"
server_key_iv: "88e6673f3260fb989d1089a2a7f212eb"
server_key_version: "encryptionkey@0"
I20260806 20:34:46.156278 4106 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:34:46.159924 4131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:46.161307 4106 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 20:34:46.161530 4106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "4595084996934db4bc43a472f6a6c6fa"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "b09975ea11b9b9c8283e790a06146212"
server_key_iv: "88e6673f3260fb989d1089a2a7f212eb"
server_key_version: "encryptionkey@0"
I20260806 20:34:46.161739 4106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:46.186008 4106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:46.190680 4106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:46.190984 4106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:46.192003 4106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:46.193498 4106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:46.193608 4106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:46.193756 4106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:46.193856 4106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:46.228024 4106 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:46869
I20260806 20:34:46.228084 4299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:46869 every 8 connection(s)
I20260806 20:34:46.229419 4106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:34:46.239800 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 4106
I20260806 20:34:46.240059 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:34:46.240885 13909 external_mini_cluster.cc:1428] Setting key 9ab35fc03b9393e2021453202c3e4838
Aug 06 20:34:46 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048486, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:46.251986 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.232091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:49047 (local address 127.13.149.126:35397)
0806 20:34:46.232541 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:46.232545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:46.233649 (+ 1104us) server_negotiation.cc:407] Connection header received
0806 20:34:46.235497 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:46.235512 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:46.235611 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:46.235744 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:46.237387 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.238127 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.240007 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.240505 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.240612 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.244960 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:46.244966 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:46.244969 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:46.245002 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:46.247652 (+ 2650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:46.248401 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:46.248411 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:46.248413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:46.248539 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:46.249108 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:46.249112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:46.249114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:46.249388 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:46.249577 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:46.250795 (+ 1218us) server_negotiation.cc:299] Negotiation successful
0806 20:34:46.251220 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":225,"threads_started":1}
I20260806 20:34:46.252821 4304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.232709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:49047)
0806 20:34:46.233493 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:46.233533 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:46.235226 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:46.236056 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:46.236063 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:46.236578 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:46.237202 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.237220 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.238301 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.238306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.239775 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.239794 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.240771 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.240809 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.241190 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.242095 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:46.242131 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:46.244694 (+ 2563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:46.247794 (+ 3100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:46.247804 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:46.247821 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:46.248260 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:46.248681 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:46.248686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:46.248690 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:46.248968 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:46.249632 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:46.249644 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:46.250183 (+ 539us) client_negotiation.cc:769] Sending connection context
0806 20:34:46.250543 (+ 360us) client_negotiation.cc:240] Negotiation successful
0806 20:34:46.251183 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":275,"threads_started":1}
I20260806 20:34:46.254729 4300 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35397
I20260806 20:34:46.255095 4300 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:46.256074 4300 heartbeater.cc:511] Master 127.13.149.126:35397 requested a full tablet report, sending...
I20260806 20:34:46.258142 3811 ts_manager.cc:194] Registered new tserver with Master: 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869)
I20260806 20:34:46.259589 3811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:49047
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:34:46.308485 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35397
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:46.658712 4307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:46.658998 4307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:46.659093 4307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:46.666610 4307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:46.666735 4307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:46.666922 4307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:34:46.679417 4307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:46.680644 4307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:46.681962 4307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:46.696280 4315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:46.696383 4314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:46.696365 4322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:46.697214 4307 server_base.cc:1034] running on GCE node
I20260806 20:34:46.697957 4307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:46.698908 4307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:46.700177 4307 hybrid_clock.cc:648] HybridClock initialized: now 1786048486700124 us; error 63 us; skew 500 ppm
I20260806 20:34:46.700531 4307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:46 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048486, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:46.703776 4307 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:34:46.704475 4093 heartbeater.cc:503] Master 127.13.149.126:35397 was elected leader, sending a full tablet report...
I20260806 20:34:46.705610 4307 webserver.cc:460] Webserver started at http://127.13.149.67:42021/ using document root <none> and password file <none>
I20260806 20:34:46.706386 4307 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:46.706568 4307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:46.706861 4307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:34:46.709890 4307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "1b5f89909ced43dfb211b7e5b953eb23"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "4d832b22d85f476222f49bc5db8fadf3"
server_key_iv: "bee4751add639486d57030b1ea28840a"
server_key_version: "encryptionkey@0"
I20260806 20:34:46.710636 4307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "1b5f89909ced43dfb211b7e5b953eb23"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "4d832b22d85f476222f49bc5db8fadf3"
server_key_iv: "bee4751add639486d57030b1ea28840a"
server_key_version: "encryptionkey@0"
I20260806 20:34:46.715822 4307 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:34:46.719309 4331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:46.720639 4307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:34:46.720772 4307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "1b5f89909ced43dfb211b7e5b953eb23"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "4d832b22d85f476222f49bc5db8fadf3"
server_key_iv: "bee4751add639486d57030b1ea28840a"
server_key_version: "encryptionkey@0"
I20260806 20:34:46.721012 4307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:46.738386 4307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:46.742319 4307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:46.742560 4307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:46.743429 4307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:46.744705 4307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:46.744825 4307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:46.744951 4307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:46.744997 4307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:46.778951 4307 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:43313
I20260806 20:34:46.778955 4492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:43313 every 8 connection(s)
I20260806 20:34:46.780248 4307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:34:46.789417 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 4307
I20260806 20:34:46.789616 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:34:46.790063 13909 external_mini_cluster.cc:1428] Setting key 67a90108f2756d4808deb1eff1a587d9
Aug 06 20:34:46 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048486, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:46.799656 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.782855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:47239 (local address 127.13.149.126:35397)
0806 20:34:46.783266 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:46.783272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:46.784291 (+ 1019us) server_negotiation.cc:407] Connection header received
0806 20:34:46.786247 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:46.786252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:46.786340 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:46.786437 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:46.787820 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.788626 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.790502 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.790891 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.791040 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.794621 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:46.794625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:46.794629 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:46.794659 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:46.797120 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:46.797779 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:46.797783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:46.797785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:46.797937 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:46.798297 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:46.798300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:46.798302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:46.798541 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:46.798658 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:46.799236 (+ 578us) server_negotiation.cc:299] Negotiation successful
0806 20:34:46.799391 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":201,"threads_started":1}
I20260806 20:34:46.800523 4498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.783412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:47239)
0806 20:34:46.784096 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:46.784133 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:46.785991 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:46.786644 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:46.786651 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:46.787137 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:46.787673 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.787689 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.788766 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.788770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.790318 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.790330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.791129 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.791138 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.791364 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.792121 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:46.792146 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:46.794439 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:46.797241 (+ 2802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:46.797247 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:46.797257 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:46.797673 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:46.798030 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:46.798033 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:46.798035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:46.798201 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:46.798647 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:46.798652 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:46.798927 (+ 275us) client_negotiation.cc:769] Sending connection context
0806 20:34:46.799135 (+ 208us) client_negotiation.cc:240] Negotiation successful
0806 20:34:46.799472 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":278,"threads_started":1}
I20260806 20:34:46.801810 4494 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35397
I20260806 20:34:46.802103 4494 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:46.802820 4494 heartbeater.cc:511] Master 127.13.149.126:35397 requested a full tablet report, sending...
I20260806 20:34:46.804384 3811 ts_manager.cc:194] Registered new tserver with Master: 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67:43313)
I20260806 20:34:46.805491 3811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:47239
I20260806 20:34:46.805723 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:34:46.822506 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.810448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51456 (local address 127.13.149.126:35397)
0806 20:34:46.810662 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:46.810671 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:46.810980 (+ 309us) server_negotiation.cc:407] Connection header received
0806 20:34:46.811106 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:46.811109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:46.811167 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:46.811246 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:46.812675 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.813498 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.814756 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.815144 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.815233 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.817611 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:46.817616 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:46.817619 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:46.817648 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:46.819938 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:46.820596 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:46.820600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:46.820602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:46.820714 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:46.821187 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:46.821190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:46.821192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:46.821498 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:46.821682 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:46.822012 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 20:34:46.822167 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:34:46.826850 3811 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:34:46.833806 3811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:34:46.856348 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.846243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.13.149.67:43313)
0806 20:34:46.847019 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:46.847028 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:46.847462 (+ 434us) server_negotiation.cc:407] Connection header received
0806 20:34:46.847713 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:46.847722 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:46.847990 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:46.848249 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:46.849826 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.851411 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.854142 (+ 2731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.855091 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.855254 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.855522 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:46.855823 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 20:34:46.855999 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":352,"threads_started":1}
I20260806 20:34:46.856364 4510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.846010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43313 (local address 127.0.0.1:43814)
0806 20:34:46.847307 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:46.847338 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:46.847501 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:46.848275 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:46.848286 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:46.848339 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:46.848969 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.848989 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.851601 (+ 2612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.851608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.853949 (+ 2341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.853965 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.855310 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.855317 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.855541 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.855605 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 20:34:46.855767 (+ 162us) client_negotiation.cc:240] Negotiation successful
0806 20:34:46.855994 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1115,"thread_start_us":992,"threads_started":1}
I20260806 20:34:46.858958 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.848050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56490 (local address 127.13.149.65:40649)
0806 20:34:46.849674 (+ 1624us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:46.849682 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:46.849709 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:34:46.850365 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:46.850374 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:46.850586 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:46.850752 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:46.851675 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.853187 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.855945 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.857501 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.857656 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.857896 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:46.858470 (+ 574us) server_negotiation.cc:299] Negotiation successful
0806 20:34:46.858632 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1447,"thread_start_us":1271,"threads_started":1}
I20260806 20:34:46.858975 4515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.847745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:56490)
0806 20:34:46.849025 (+ 1280us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:46.849044 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:46.849564 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:46.850933 (+ 1369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:46.850938 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:46.850960 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:46.851401 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.851430 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.853359 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.853365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.855746 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.855761 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.858069 (+ 2308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.858077 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.858270 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.858305 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 20:34:46.858403 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 20:34:46.858548 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"mutex_wait_us":24,"thread_start_us":955,"threads_started":1}
I20260806 20:34:46.858994 4519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.849337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.13.149.66:46869)
0806 20:34:46.850143 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:46.850154 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:46.850705 (+ 551us) server_negotiation.cc:407] Connection header received
0806 20:34:46.850916 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:46.850924 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:46.851141 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:46.851363 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:46.852161 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.853702 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.856256 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.857715 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.857845 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.858038 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:46.858527 (+ 489us) server_negotiation.cc:299] Negotiation successful
0806 20:34:46.858702 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":560,"threads_started":1}
I20260806 20:34:46.859747 4521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:46.849703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46869 (local address 127.0.0.1:35966)
0806 20:34:46.850582 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:46.850596 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:46.850731 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:46.851370 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:46.851375 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:46.851405 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:46.851964 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.851976 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.853883 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.853888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.856075 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:46.856090 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:46.858173 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:46.858179 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:46.858319 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:46.858352 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 20:34:46.859247 (+ 895us) client_negotiation.cc:240] Negotiation successful
0806 20:34:46.859386 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"mutex_wait_us":1,"thread_start_us":639,"threads_started":1}
I20260806 20:34:46.861107 4400 tablet_service.cc:1467] Processing CreateTablet for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 (DEFAULT_TABLE table=test-table [id=96ce868b5085434fb567d74b892bd5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:46.862470 4400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:46.862579 3994 tablet_service.cc:1467] Processing CreateTablet for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 (DEFAULT_TABLE table=test-table [id=96ce868b5085434fb567d74b892bd5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:46.863154 4193 tablet_service.cc:1467] Processing CreateTablet for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 (DEFAULT_TABLE table=test-table [id=96ce868b5085434fb567d74b892bd5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:46.864007 3994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:46.864487 4193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:46.874365 4522 tablet_bootstrap.cc:492] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Bootstrap starting.
I20260806 20:34:46.878146 4522 tablet_bootstrap.cc:654] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:46.878578 4524 tablet_bootstrap.cc:492] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Bootstrap starting.
I20260806 20:34:46.879655 4522 log.cc:824] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:46.881151 4523 tablet_bootstrap.cc:492] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Bootstrap starting.
I20260806 20:34:46.882313 4524 tablet_bootstrap.cc:654] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:46.883569 4522 tablet_bootstrap.cc:492] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: No bootstrap required, opened a new log
I20260806 20:34:46.883605 4524 log.cc:824] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:46.883847 4522 ts_tablet_manager.cc:1397] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 20:34:46.885455 4523 tablet_bootstrap.cc:654] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:46.886432 4523 log.cc:824] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:46.889715 4524 tablet_bootstrap.cc:492] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: No bootstrap required, opened a new log
I20260806 20:34:46.890009 4524 ts_tablet_manager.cc:1397] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260806 20:34:46.890516 4523 tablet_bootstrap.cc:492] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: No bootstrap required, opened a new log
I20260806 20:34:46.890817 4523 ts_tablet_manager.cc:1397] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260806 20:34:46.895340 4522 raft_consensus.cc:348] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:46.895789 4522 raft_consensus.cc:374] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:46.895884 4522 raft_consensus.cc:729] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b5f89909ced43dfb211b7e5b953eb23, State: Initialized, Role: FOLLOWER
I20260806 20:34:46.896492 4522 consensus_queue.cc:260] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:46.897684 4494 heartbeater.cc:503] Master 127.13.149.126:35397 was elected leader, sending a full tablet report...
I20260806 20:34:46.897836 4524 raft_consensus.cc:348] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:46.898254 4524 raft_consensus.cc:374] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:46.898331 4522 ts_tablet_manager.cc:1428] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260806 20:34:46.898351 4524 raft_consensus.cc:729] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e4b4ec629b46178f67c0e6e20b46e0, State: Initialized, Role: FOLLOWER
I20260806 20:34:46.898988 4524 consensus_queue.cc:260] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:46.900655 4524 ts_tablet_manager.cc:1428] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260806 20:34:46.900990 4523 raft_consensus.cc:348] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:46.901361 4523 raft_consensus.cc:374] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:46.901485 4523 raft_consensus.cc:729] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4595084996934db4bc43a472f6a6c6fa, State: Initialized, Role: FOLLOWER
I20260806 20:34:46.902112 4523 consensus_queue.cc:260] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:46.903786 4523 ts_tablet_manager.cc:1428] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260806 20:34:46.903972 4300 heartbeater.cc:503] Master 127.13.149.126:35397 was elected leader, sending a full tablet report...
W20260806 20:34:46.924023 4094 tablet.cc:2369] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:34:46.981514 4302 tablet.cc:2369] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:34:47.031968 4495 tablet.cc:2369] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:47.153560 4531 raft_consensus.cc:482] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:34:47.153862 4531 raft_consensus.cc:504] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:47.155550 4531 leader_election.cc:288] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649), 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869)
I20260806 20:34:47.161677 4498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.156112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.13.149.67:44261)
0806 20:34:47.156321 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:47.156339 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:47.156454 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:47.156958 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:47.156963 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:47.156993 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:47.157224 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:47.157242 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.158491 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.158497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:47.159755 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:47.159766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.160913 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.160921 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:47.161117 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.161142 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 20:34:47.161265 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 20:34:47.161405 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 20:34:47.161681 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.156125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44261 (local address 127.13.149.65:40649)
0806 20:34:47.156403 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:47.156412 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:47.156441 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:34:47.156653 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:47.156660 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:47.156757 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:47.156921 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:47.157398 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.158354 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.159941 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.160717 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.160943 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.161022 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:47.161307 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 20:34:47.161432 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 20:34:47.162986 4534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.156610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46869 (local address 127.13.149.67:51567)
0806 20:34:47.157651 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:47.157667 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:47.157781 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:47.158085 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:47.158088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:47.158108 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:47.158414 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:47.158422 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.159511 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.159515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:47.160997 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:47.161010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.162426 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.162430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:47.162542 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.162565 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 20:34:47.162641 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 20:34:47.162720 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"thread_start_us":712,"threads_started":1}
I20260806 20:34:47.162840 4029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a7c41eaacc4b5d9f4228c95b95d3d7" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" is_pre_election: true
I20260806 20:34:47.163166 4519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.156973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:51567 (local address 127.13.149.66:46869)
0806 20:34:47.157196 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:47.157202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:47.157769 (+ 567us) server_negotiation.cc:407] Connection header received
0806 20:34:47.157883 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:47.157888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:47.157962 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:47.158054 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:47.158596 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.159330 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.161168 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.162235 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.162423 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.162509 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:47.162703 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 20:34:47.162855 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 20:34:47.163517 4029 raft_consensus.cc:2454] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b5f89909ced43dfb211b7e5b953eb23 in term 0.
I20260806 20:34:47.164304 4340 leader_election.cc:302] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5f89909ced43dfb211b7e5b953eb23, b5e4b4ec629b46178f67c0e6e20b46e0; no voters:
I20260806 20:34:47.164261 4222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a7c41eaacc4b5d9f4228c95b95d3d7" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4595084996934db4bc43a472f6a6c6fa" is_pre_election: true
I20260806 20:34:47.164765 4531 raft_consensus.cc:2781] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:34:47.164964 4531 raft_consensus.cc:482] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:34:47.164937 4222 raft_consensus.cc:2454] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b5f89909ced43dfb211b7e5b953eb23 in term 0.
I20260806 20:34:47.165079 4531 raft_consensus.cc:3037] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:47.167539 4531 raft_consensus.cc:504] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:47.168144 4531 leader_election.cc:288] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 election: Requested vote from peers b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649), 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869)
I20260806 20:34:47.168594 4029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a7c41eaacc4b5d9f4228c95b95d3d7" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
I20260806 20:34:47.168665 4222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a7c41eaacc4b5d9f4228c95b95d3d7" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4595084996934db4bc43a472f6a6c6fa"
I20260806 20:34:47.168861 4029 raft_consensus.cc:3037] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:47.168926 4222 raft_consensus.cc:3037] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:47.171113 4222 raft_consensus.cc:2454] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b5f89909ced43dfb211b7e5b953eb23 in term 1.
I20260806 20:34:47.171123 4029 raft_consensus.cc:2454] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b5f89909ced43dfb211b7e5b953eb23 in term 1.
I20260806 20:34:47.171521 4340 leader_election.cc:302] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5f89909ced43dfb211b7e5b953eb23, 4595084996934db4bc43a472f6a6c6fa; no voters:
I20260806 20:34:47.171834 4531 raft_consensus.cc:2781] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:34:47.172350 4531 raft_consensus.cc:686] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 LEADER]: Becoming Leader. State: Replica: 1b5f89909ced43dfb211b7e5b953eb23, State: Running, Role: LEADER
I20260806 20:34:47.172927 4531 consensus_queue.cc:237] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } }
I20260806 20:34:47.177722 3811 catalog_manager.cc:5495] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "1b5f89909ced43dfb211b7e5b953eb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } health_report { overall_health: UNKNOWN } } }
I20260806 20:34:47.224049 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.218031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43830 (local address 127.13.149.67:43313)
0806 20:34:47.218298 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:47.218305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:47.218329 (+ 24us) server_negotiation.cc:407] Connection header received
0806 20:34:47.218553 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:47.218558 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:47.218645 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:47.218888 (+ 243us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:34:47.219287 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.220044 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.221667 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.222107 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.222264 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.222839 (+ 575us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:34:47.223346 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:34:47.223521 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:47.223631 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 20:34:47.223723 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 20:34:47.232890 4029 raft_consensus.cc:1261] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Refusing update from remote peer 1b5f89909ced43dfb211b7e5b953eb23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:47.232896 4222 raft_consensus.cc:1261] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Refusing update from remote peer 1b5f89909ced43dfb211b7e5b953eb23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:47.233879 4536 consensus_queue.cc:1035] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:34:47.234302 4531 consensus_queue.cc:1035] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:34:47.263748 3809 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:34:47.264053 3809 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:34:47.267936 3809 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Sending DeleteTablet for 3 replicas of tablet 99a7c41eaacc4b5d9f4228c95b95d3d7
I20260806 20:34:47.269021 4400 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:47 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:43814
I20260806 20:34:47.269332 3994 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:47 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:56490
I20260806 20:34:47.270041 4193 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:47 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:35966
I20260806 20:34:47.270223 4555 tablet_replica.cc:330] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: stopping tablet replica
I20260806 20:34:47.270658 4555 raft_consensus.cc:2229] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:34:47.270917 4556 tablet_replica.cc:330] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: stopping tablet replica
I20260806 20:34:47.271173 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 3910
I20260806 20:34:47.271306 4556 raft_consensus.cc:2229] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:34:47.271356 4555 raft_consensus.cc:2258] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:47.271775 4556 raft_consensus.cc:2258] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:47.274088 4555 ts_tablet_manager.cc:1905] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:47.279960 4556 ts_tablet_manager.cc:1905] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:47.281550 4555 ts_tablet_manager.cc:1918] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:47.281782 4555 log.cc:1196] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/99a7c41eaacc4b5d9f4228c95b95d3d7
I20260806 20:34:47.282462 4555 ts_tablet_manager.cc:1939] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P b5e4b4ec629b46178f67c0e6e20b46e0: Deleting consensus metadata
I20260806 20:34:47.285131 3783 catalog_manager.cc:4841] TS b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649): tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 (table test-table [id=96ce868b5085434fb567d74b892bd5f2]) successfully deleted
I20260806 20:34:47.285960 4554 tablet_replica.cc:330] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: stopping tablet replica
I20260806 20:34:47.286388 4554 raft_consensus.cc:2229] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:34:47.287176 4554 raft_consensus.cc:2258] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:47.289034 4554 ts_tablet_manager.cc:1905] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:47.289376 4556 ts_tablet_manager.cc:1918] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:47.289535 4556 log.cc:1196] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/99a7c41eaacc4b5d9f4228c95b95d3d7
I20260806 20:34:47.290225 4556 ts_tablet_manager.cc:1939] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 4595084996934db4bc43a472f6a6c6fa: Deleting consensus metadata
I20260806 20:34:47.292291 3783 catalog_manager.cc:4841] TS 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869): tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 (table test-table [id=96ce868b5085434fb567d74b892bd5f2]) successfully deleted
Aug 06 20:34:47 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:34:47.296037 4554 ts_tablet_manager.cc:1918] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:47.296219 4554 log.cc:1196] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/99a7c41eaacc4b5d9f4228c95b95d3d7
I20260806 20:34:47.296896 4554 ts_tablet_manager.cc:1939] T 99a7c41eaacc4b5d9f4228c95b95d3d7 P 1b5f89909ced43dfb211b7e5b953eb23: Deleting consensus metadata
I20260806 20:34:47.298393 3783 catalog_manager.cc:4841] TS 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67:43313): tablet 99a7c41eaacc4b5d9f4228c95b95d3d7 (table test-table [id=96ce868b5085434fb567d74b892bd5f2]) successfully deleted
I20260806 20:34:47.302690 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.272451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56496 (local address 127.13.149.65:40649)
0806 20:34:47.272648 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:47.272656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:47.281992 (+ 9336us) server_negotiation.cc:407] Connection header received
0806 20:34:47.283015 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:47.283021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:47.283117 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:47.283190 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:47.285326 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.286458 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.288712 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.289389 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.289491 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.295710 (+ 6219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:47.295725 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:47.295743 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:47.295790 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:47.299745 (+ 3955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:47.300436 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:47.300459 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:47.300463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:47.300622 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:47.301086 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:47.301091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:47.301094 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:47.301546 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:47.301874 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:47.302080 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 20:34:47.302304 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 20:34:47.303373 4088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:47.395689 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 3910
I20260806 20:34:47.432008 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 4106
Aug 06 20:34:47 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:34:47.448125 4519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.432912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35976 (local address 127.13.149.66:46869)
0806 20:34:47.433115 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:47.433121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:47.433143 (+ 22us) server_negotiation.cc:407] Connection header received
0806 20:34:47.433358 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:47.433363 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:47.433455 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:47.433568 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:47.434881 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.435642 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.436986 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.437408 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.437548 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.442145 (+ 4597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:47.442161 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:47.442178 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:47.442212 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:47.445195 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:47.445924 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:47.445931 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:47.445934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:47.446075 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:47.446473 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:47.446477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:47.446479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:47.446849 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:47.447177 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:47.447503 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 20:34:47.447752 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:34:47.449011 4294 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:47.541607 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 4106
I20260806 20:34:47.567939 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 4307
Aug 06 20:34:47 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:34:47.585224 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:47.568826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43836 (local address 127.13.149.67:43313)
0806 20:34:47.569007 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:47.569013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:47.569121 (+ 108us) server_negotiation.cc:407] Connection header received
0806 20:34:47.569440 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:47.569446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:47.569527 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:47.569658 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:47.570976 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.571803 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.573340 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:47.573831 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:47.573977 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:47.578527 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:47.578541 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:47.578560 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:47.578599 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:47.581844 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:47.582570 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:47.582577 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:47.582584 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:47.582738 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:47.583143 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:47.583147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:47.583149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:47.583486 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:47.583840 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:47.584126 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 20:34:47.584340 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:34:47.586158 4488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:47.709795 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 4307
I20260806 20:34:47.737804 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 3757
I20260806 20:34:47.739089 3850 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:47.850749 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 3757
I20260806 20:34:47.883790 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35397
--webserver_interface=127.13.149.126
--webserver_port=43875
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:35397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:48.225957 4567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:48.226227 4567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:48.226400 4567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:48.233686 4567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:48.233783 4567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:48.233875 4567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:48.233968 4567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:48.234086 4567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:48.244525 4567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:35397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=43875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:48.245904 4567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:48.247237 4567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:48.280135 4575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:48.280678 4577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:48.281418 4574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:48.282755 4567 server_base.cc:1034] running on GCE node
I20260806 20:34:48.284055 4567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:48.285976 4567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:48.287237 4567 hybrid_clock.cc:648] HybridClock initialized: now 1786048488287194 us; error 54 us; skew 500 ppm
I20260806 20:34:48.287686 4567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:48 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048488, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:48.291566 4567 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:34:48.293511 4567 webserver.cc:460] Webserver started at http://127.13.149.126:43875/ using document root <none> and password file <none>
I20260806 20:34:48.294363 4567 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:48.294548 4567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:48.300686 4567 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 20:34:48.303678 4589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:48.305109 4567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:34:48.305313 4567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "cefb87e53028472fbdac79a6762b5114"
format_stamp: "Formatted at 2026-08-06 20:34:44 on dist-test-slave-2kcd"
server_key: "e7ef320296fb05e5038bc660fff80269"
server_key_iv: "9e1b46ab696462f4ae829c9f84a9ef41"
server_key_version: "encryptionkey@0"
I20260806 20:34:48.306427 4567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:48.335238 4567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:48.339764 4567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:48.340090 4567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:48.360584 4567 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:35397
I20260806 20:34:48.360603 4665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:35397 every 8 connection(s)
I20260806 20:34:48.362346 4567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:34:48.362895 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 4567
I20260806 20:34:48.364022 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:40649
--local_ip_for_outbound_sockets=127.13.149.65
--tserver_master_addrs=127.13.149.126:35397
--webserver_port=34653
--webserver_interface=127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:34:48.370100 4666 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:34:48.373636 4666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Bootstrap starting.
I20260806 20:34:48.402691 4666 log.cc:824] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:48.419028 4666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:34:48.419691 4666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Bootstrap complete.
I20260806 20:34:48.434247 4666 raft_consensus.cc:348] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:48.435516 4666 raft_consensus.cc:729] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefb87e53028472fbdac79a6762b5114, State: Initialized, Role: FOLLOWER
I20260806 20:34:48.436273 4666 consensus_queue.cc:260] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:48.436573 4666 raft_consensus.cc:388] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:34:48.436713 4666 raft_consensus.cc:482] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:34:48.436919 4666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 1 FOLLOWER]: Advancing to term 2
I20260806 20:34:48.443871 4666 raft_consensus.cc:504] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:48.444550 4666 leader_election.cc:302] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cefb87e53028472fbdac79a6762b5114; no voters:
I20260806 20:34:48.445256 4666 leader_election.cc:288] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 20:34:48.445413 4672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 20:34:48.447002 4672 raft_consensus.cc:686] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 LEADER]: Becoming Leader. State: Replica: cefb87e53028472fbdac79a6762b5114, State: Running, Role: LEADER
I20260806 20:34:48.447618 4666 sys_catalog.cc:564] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:48.447517 4672 consensus_queue.cc:237] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:48.450191 4674 sys_catalog.cc:455] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cefb87e53028472fbdac79a6762b5114. Latest consensus state: current_term: 2 leader_uuid: "cefb87e53028472fbdac79a6762b5114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } } }
I20260806 20:34:48.450579 4674 sys_catalog.cc:458] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:48.451625 4673 sys_catalog.cc:455] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cefb87e53028472fbdac79a6762b5114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } } }
I20260806 20:34:48.452044 4673 sys_catalog.cc:458] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:48.461454 4682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:34:48.469925 4682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:34:48.472245 4682 catalog_manager.cc:1259] Loaded cluster ID: 85c2d49eaf894862a567706d9d94b88b
I20260806 20:34:48.472358 4682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:34:48.475780 4682 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 20:34:48.494181 4682 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 20:34:48.504725 4682 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:34:48.506560 4682 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Loaded TSK: 0
I20260806 20:34:48.508116 4682 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 20:34:48.759199 4669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:48.759534 4669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:48.759707 4669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:48.767339 4669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:48.767488 4669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:48.767675 4669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:34:48.777480 4669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:40649
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=34653
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:48.778857 4669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:48.780236 4669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:48.795297 4706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:48.795287 4708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:48.795945 4711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:48.796046 4669 server_base.cc:1034] running on GCE node
I20260806 20:34:48.796809 4669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:48.797883 4669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:48.799141 4669 hybrid_clock.cc:648] HybridClock initialized: now 1786048488799078 us; error 52 us; skew 500 ppm
I20260806 20:34:48.799515 4669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:48 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048488, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:48.803453 4669 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:34:48.805236 4669 webserver.cc:460] Webserver started at http://127.13.149.65:34653/ using document root <none> and password file <none>
I20260806 20:34:48.806099 4669 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:48.806252 4669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:48.813445 4669 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 20:34:48.816892 4721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:48.818676 4669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:34:48.818857 4669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
format_stamp: "Formatted at 2026-08-06 20:34:45 on dist-test-slave-2kcd"
server_key: "794ebe482e290a24b8fb0218623b462d"
server_key_iv: "f04991092ab81a54ea488f3f309bea29"
server_key_version: "encryptionkey@0"
I20260806 20:34:48.820267 4669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:48.866827 4669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:48.871361 4669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:48.871615 4669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:48.872738 4669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:48.874233 4669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:48.874341 4669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:48.874415 4669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:48.874467 4669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:48.910409 4669 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:40649
I20260806 20:34:48.910596 4882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:40649 every 8 connection(s)
I20260806 20:34:48.912062 4669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:34:48.921309 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 4669
I20260806 20:34:48.921973 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:46869
--local_ip_for_outbound_sockets=127.13.149.66
--tserver_master_addrs=127.13.149.126:35397
--webserver_port=45969
--webserver_interface=127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:34:48 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048488, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:48.935578 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:48.915247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:36943 (local address 127.13.149.126:35397)
0806 20:34:48.915802 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:48.915813 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:48.916607 (+ 794us) server_negotiation.cc:407] Connection header received
0806 20:34:48.918696 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:48.918708 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:48.919029 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:48.919310 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:48.920703 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:48.922137 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:48.923676 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:48.924291 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:48.924503 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:48.928280 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:48.928288 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:48.928302 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:48.928342 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:48.931140 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:48.931854 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:48.931867 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:48.931872 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:48.932028 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:48.932463 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:48.932470 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:48.932473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:48.932985 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:48.933184 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:48.933919 (+ 735us) server_negotiation.cc:299] Negotiation successful
0806 20:34:48.934310 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":245,"threads_started":1}
I20260806 20:34:48.935572 4886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:48.915542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:36943)
0806 20:34:48.916424 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:48.916471 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:48.918225 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:48.919463 (+ 1238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:48.919470 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:48.919971 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:48.920491 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:48.920507 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:48.922323 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:48.922327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:48.923517 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:48.923529 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:48.924544 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:48.924550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:48.924897 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:48.925650 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:48.925672 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:48.928013 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:48.931285 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:48.931295 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:48.931308 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:48.931715 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:48.932146 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:48.932153 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:48.932157 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:48.932345 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:48.933120 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:48.933128 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:48.933450 (+ 322us) client_negotiation.cc:769] Sending connection context
0806 20:34:48.933722 (+ 272us) client_negotiation.cc:240] Negotiation successful
0806 20:34:48.934268 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":371,"threads_started":1}
I20260806 20:34:48.938633 4883 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35397
I20260806 20:34:48.938963 4883 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:48.939957 4883 heartbeater.cc:511] Master 127.13.149.126:35397 requested a full tablet report, sending...
I20260806 20:34:48.942664 4613 ts_manager.cc:194] Registered new tserver with Master: b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649)
I20260806 20:34:48.945000 4613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:36943
W20260806 20:34:49.282248 4892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:49.282625 4892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:49.282737 4892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:49.290230 4892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:49.290354 4892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:49.290474 4892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:34:49.300520 4892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:46869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=45969
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:49.301968 4892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:49.303470 4892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:49.318010 4898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:49.317955 4899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:49.318027 4902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:49.318625 4892 server_base.cc:1034] running on GCE node
I20260806 20:34:49.319267 4892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:49.320160 4892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:49.321367 4892 hybrid_clock.cc:648] HybridClock initialized: now 1786048489321326 us; error 36 us; skew 500 ppm
I20260806 20:34:49.321702 4892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:49 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048489, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:49.325073 4892 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:34:49.326608 4892 webserver.cc:460] Webserver started at http://127.13.149.66:45969/ using document root <none> and password file <none>
I20260806 20:34:49.327263 4892 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:49.327394 4892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:49.332686 4892 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:34:49.335435 4912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:49.336941 4892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:34:49.337131 4892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "4595084996934db4bc43a472f6a6c6fa"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "b09975ea11b9b9c8283e790a06146212"
server_key_iv: "88e6673f3260fb989d1089a2a7f212eb"
server_key_version: "encryptionkey@0"
I20260806 20:34:49.338120 4892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:49.369123 4892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:49.374511 4892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:49.374814 4892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:49.376035 4892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:49.377700 4892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:49.377812 4892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:49.377931 4892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:49.378008 4892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:49.414140 4892 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:46869
I20260806 20:34:49.414197 5082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:46869 every 8 connection(s)
I20260806 20:34:49.415622 4892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:34:49.425316 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 4892
I20260806 20:34:49.426017 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:43313
--local_ip_for_outbound_sockets=127.13.149.67
--tserver_master_addrs=127.13.149.126:35397
--webserver_port=42021
--webserver_interface=127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:34:49 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048489, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:49.437826 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.418313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:56783 (local address 127.13.149.126:35397)
0806 20:34:49.418511 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:49.418516 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:49.419650 (+ 1134us) server_negotiation.cc:407] Connection header received
0806 20:34:49.421589 (+ 1939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:49.421595 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:49.421732 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:49.421854 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:49.423386 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.424103 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.425999 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.426777 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.426933 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.430461 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:49.430470 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:49.430478 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:49.430525 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:49.434305 (+ 3780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:49.435114 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:49.435122 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:49.435128 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:49.435294 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:49.435704 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:49.435711 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:49.435716 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:49.436129 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:49.436286 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:49.437110 (+ 824us) server_negotiation.cc:299] Negotiation successful
0806 20:34:49.437382 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 20:34:49.438532 5086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.418772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:56783)
0806 20:34:49.419490 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:49.419534 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:49.421312 (+ 1778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:49.422107 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:49.422115 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:49.422623 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:49.423200 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.423217 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.424287 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.424291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.425735 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.425747 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.427031 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.427036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.427226 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.427953 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:49.427975 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:49.430245 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:49.434468 (+ 4223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:49.434475 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:49.434488 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:49.434968 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:49.435404 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:49.435407 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:49.435409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:49.435586 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:49.436271 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:49.436278 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:49.436624 (+ 346us) client_negotiation.cc:769] Sending connection context
0806 20:34:49.436945 (+ 321us) client_negotiation.cc:240] Negotiation successful
0806 20:34:49.437356 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":284,"threads_started":1}
I20260806 20:34:49.440150 5083 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35397
I20260806 20:34:49.440490 5083 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:49.441417 5083 heartbeater.cc:511] Master 127.13.149.126:35397 requested a full tablet report, sending...
I20260806 20:34:49.443202 4613 ts_manager.cc:194] Registered new tserver with Master: 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869)
I20260806 20:34:49.444074 4613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:56783
W20260806 20:34:49.776991 5087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:49.777316 5087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:49.777495 5087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:49.784819 5087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:49.784991 5087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:49.785173 5087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:34:49.794950 5087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:43313
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=42021
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:49.796280 5087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:49.797631 5087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:49.810956 5098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:49.811074 5095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:49.811075 5096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:49.812107 5087 server_base.cc:1034] running on GCE node
I20260806 20:34:49.812661 5087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:49.813578 5087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:49.814772 5087 hybrid_clock.cc:648] HybridClock initialized: now 1786048489814733 us; error 33 us; skew 500 ppm
I20260806 20:34:49.815074 5087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:49 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048489, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:49.818228 5087 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:34:49.819589 5087 webserver.cc:460] Webserver started at http://127.13.149.67:42021/ using document root <none> and password file <none>
I20260806 20:34:49.820252 5087 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:49.820439 5087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:49.825933 5087 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 20:34:49.828568 5111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:49.829950 5087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:34:49.830128 5087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "1b5f89909ced43dfb211b7e5b953eb23"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "4d832b22d85f476222f49bc5db8fadf3"
server_key_iv: "bee4751add639486d57030b1ea28840a"
server_key_version: "encryptionkey@0"
I20260806 20:34:49.831121 5087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:49.847749 5087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:49.851940 5087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:49.852229 5087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:49.853250 5087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:49.854578 5087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:49.854713 5087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:49.854840 5087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:49.854940 5087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:49.889109 5087 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:43313
I20260806 20:34:49.889197 5293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:43313 every 8 connection(s)
I20260806 20:34:49.890596 5087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:34:49.899987 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 5087
Aug 06 20:34:49 dist-test-slave-2kcd krb5kdc[3737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048489, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:34:49.913187 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.893289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44871 (local address 127.13.149.126:35397)
0806 20:34:49.893478 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:49.893483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:49.894639 (+ 1156us) server_negotiation.cc:407] Connection header received
0806 20:34:49.896473 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:49.896478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:49.896547 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:49.896639 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:49.898134 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.898844 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.900430 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.901079 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.901231 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.905451 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:49.905460 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:49.905465 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:49.905508 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:49.908993 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:49.909867 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:49.909873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:49.909876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:49.910016 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:49.910569 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:49.910572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:49.910575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:49.910918 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:49.911096 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:49.912008 (+ 912us) server_negotiation.cc:299] Negotiation successful
0806 20:34:49.912617 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 20:34:49.914674 5297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.893769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:44871)
0806 20:34:49.894466 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:49.894503 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:49.896211 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:49.896896 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:49.896922 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:49.897422 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:34:49.897977 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.897994 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.898993 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.898997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.900276 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.900288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.901356 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.901367 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.901732 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.902892 (+ 1160us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:34:49.902917 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:34:49.905231 (+ 2314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:34:49.909172 (+ 3941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:49.909179 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:49.909195 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:49.909726 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:49.910139 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:34:49.910147 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:34:49.910153 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:34:49.910381 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:34:49.911056 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:34:49.911063 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:34:49.911532 (+ 469us) client_negotiation.cc:769] Sending connection context
0806 20:34:49.911865 (+ 333us) client_negotiation.cc:240] Negotiation successful
0806 20:34:49.912814 (+ 949us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":272,"threads_started":1}
I20260806 20:34:49.916263 5295 heartbeater.cc:347] Connected to a master server at 127.13.149.126:35397
I20260806 20:34:49.916693 5295 heartbeater.cc:464] Registering TS with master...
I20260806 20:34:49.917704 5295 heartbeater.cc:511] Master 127.13.149.126:35397 requested a full tablet report, sending...
I20260806 20:34:49.918733 5298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.901050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51462 (local address 127.13.149.126:35397)
0806 20:34:49.902459 (+ 1409us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:49.902463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:49.902478 (+ 15us) server_negotiation.cc:407] Connection header received
0806 20:34:49.902518 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:49.902521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:49.902572 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:49.902656 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:49.904209 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.905095 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.907127 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.907774 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.907884 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.911367 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:49.911373 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:49.911379 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:49.911412 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:49.915118 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:49.916430 (+ 1312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:49.916435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:49.916438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:49.916596 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:49.917086 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:49.917091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:49.917094 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:49.917463 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:49.917779 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:49.918124 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 20:34:49.918368 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1299,"thread_start_us":1148,"threads_started":1}
I20260806 20:34:49.919454 4613 ts_manager.cc:194] Registered new tserver with Master: 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67:43313)
I20260806 20:34:49.920544 4613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:44871
I20260806 20:34:49.921696 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:34:49.928928 5298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.922743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51464 (local address 127.13.149.126:35397)
0806 20:34:49.922933 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:49.922937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:49.923787 (+ 850us) server_negotiation.cc:407] Connection header received
0806 20:34:49.923960 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:49.923964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:49.924081 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:49.924206 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:34:49.924585 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.925416 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.926951 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.927344 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.927441 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.927902 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:34:49.928373 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:34:49.928489 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:49.928592 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 20:34:49.928652 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 20:34:49.929857 4611 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:34:49.937290 4611 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:34:49.949213 4883 heartbeater.cc:503] Master 127.13.149.126:35397 was elected leader, sending a full tablet report...
I20260806 20:34:49.960541 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.949414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46869 (local address 127.0.0.1:35978)
0806 20:34:49.950438 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:49.950488 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:49.950689 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:49.952032 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:49.952040 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:49.952072 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:49.952586 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.952601 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.954935 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.954940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.957490 (+ 2550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.957506 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.959447 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.959454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.959685 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.959745 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 20:34:49.959876 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 20:34:49.960087 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"mutex_wait_us":3,"thread_start_us":519,"threads_started":1}
I20260806 20:34:49.960928 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.950729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43313 (local address 127.0.0.1:43852)
0806 20:34:49.951634 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:49.951651 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:49.951757 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:49.953531 (+ 1774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:49.953536 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:49.953561 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:49.953895 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.953906 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.955748 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.955757 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.958398 (+ 2641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.958416 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.959834 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.959841 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.960053 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.960089 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 20:34:49.960180 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 20:34:49.960308 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":3,"thread_start_us":804,"threads_started":1}
I20260806 20:34:49.961110 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.951279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43852 (local address 127.13.149.67:43313)
0806 20:34:49.951951 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:49.951962 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:49.951997 (+ 35us) server_negotiation.cc:407] Connection header received
0806 20:34:49.952771 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:49.952802 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:49.953018 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:49.953209 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:49.954112 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.955602 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.958570 (+ 2968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.959601 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.959731 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.959964 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:49.960256 (+ 292us) server_negotiation.cc:299] Negotiation successful
0806 20:34:49.960418 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":728,"threads_started":1}
I20260806 20:34:49.961966 5309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.949708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35978 (local address 127.13.149.66:46869)
0806 20:34:49.951355 (+ 1647us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:49.951366 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:49.951401 (+ 35us) server_negotiation.cc:407] Connection header received
0806 20:34:49.951506 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:49.951514 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:49.951769 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:49.952839 (+ 1070us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:49.953126 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.954768 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.957653 (+ 2885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.959192 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.959346 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.959541 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:49.961436 (+ 1895us) server_negotiation.cc:299] Negotiation successful
0806 20:34:49.961616 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1473,"thread_start_us":1353,"threads_started":1}
I20260806 20:34:49.962493 5312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.951892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:56498)
0806 20:34:49.954424 (+ 2532us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:49.954440 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:49.954548 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:49.955428 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:49.955432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:49.955458 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:49.955969 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.955986 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.957698 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.957704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.959800 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:49.959818 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.961676 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.961683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:49.961862 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.961899 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 20:34:49.962007 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 20:34:49.962134 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2410,"thread_start_us":2281,"threads_started":1}
I20260806 20:34:49.962582 5313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:49.952106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.13.149.65:40649)
0806 20:34:49.952859 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:49.952870 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:49.954660 (+ 1790us) server_negotiation.cc:407] Connection header received
0806 20:34:49.954781 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:49.954788 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:49.955230 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:49.955428 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:49.956207 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.957350 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.959988 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:49.961418 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:49.961613 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:49.961829 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:49.962052 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 20:34:49.962209 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":328,"threads_started":1}
I20260806 20:34:49.965397 5182 tablet_service.cc:1467] Processing CreateTablet for tablet e69c1b1d20834a99bcfdc2e9ad6baf71 (DEFAULT_TABLE table=test-table [id=6fc2d514d0974fec996a77332741272a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:49.965672 4985 tablet_service.cc:1467] Processing CreateTablet for tablet e69c1b1d20834a99bcfdc2e9ad6baf71 (DEFAULT_TABLE table=test-table [id=6fc2d514d0974fec996a77332741272a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:49.966696 5182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69c1b1d20834a99bcfdc2e9ad6baf71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:49.967046 4985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69c1b1d20834a99bcfdc2e9ad6baf71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:49.966638 4794 tablet_service.cc:1467] Processing CreateTablet for tablet e69c1b1d20834a99bcfdc2e9ad6baf71 (DEFAULT_TABLE table=test-table [id=6fc2d514d0974fec996a77332741272a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:34:49.968096 4794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69c1b1d20834a99bcfdc2e9ad6baf71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:34:49.979463 5315 tablet_bootstrap.cc:492] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Bootstrap starting.
I20260806 20:34:49.982590 5316 tablet_bootstrap.cc:492] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Bootstrap starting.
I20260806 20:34:49.982929 5315 tablet_bootstrap.cc:654] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:49.984305 5317 tablet_bootstrap.cc:492] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Bootstrap starting.
I20260806 20:34:49.984315 5315 log.cc:824] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:49.986568 5316 tablet_bootstrap.cc:654] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:49.987273 5317 tablet_bootstrap.cc:654] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Neither blocks nor log segments found. Creating new log.
I20260806 20:34:49.988107 5316 log.cc:824] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:49.988245 5317 log.cc:824] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:49.991000 5317 tablet_bootstrap.cc:492] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: No bootstrap required, opened a new log
I20260806 20:34:49.991264 5317 ts_tablet_manager.cc:1397] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260806 20:34:49.994135 5315 tablet_bootstrap.cc:492] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: No bootstrap required, opened a new log
I20260806 20:34:49.994407 5316 tablet_bootstrap.cc:492] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: No bootstrap required, opened a new log
I20260806 20:34:49.994513 5315 ts_tablet_manager.cc:1397] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.006s
I20260806 20:34:49.994664 5316 ts_tablet_manager.cc:1397] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260806 20:34:50.001318 5315 raft_consensus.cc:348] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.001677 5315 raft_consensus.cc:374] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:50.001811 5315 raft_consensus.cc:729] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b5f89909ced43dfb211b7e5b953eb23, State: Initialized, Role: FOLLOWER
I20260806 20:34:50.001820 5317 raft_consensus.cc:348] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.002287 5317 raft_consensus.cc:374] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:50.002386 5317 raft_consensus.cc:729] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e4b4ec629b46178f67c0e6e20b46e0, State: Initialized, Role: FOLLOWER
I20260806 20:34:50.002506 5315 consensus_queue.cc:260] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.002935 5317 consensus_queue.cc:260] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.003728 5295 heartbeater.cc:503] Master 127.13.149.126:35397 was elected leader, sending a full tablet report...
I20260806 20:34:50.004403 5315 ts_tablet_manager.cc:1428] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260806 20:34:50.005684 5316 raft_consensus.cc:348] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.006268 5316 raft_consensus.cc:374] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:34:50.006443 5316 raft_consensus.cc:729] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4595084996934db4bc43a472f6a6c6fa, State: Initialized, Role: FOLLOWER
I20260806 20:34:50.007069 5316 consensus_queue.cc:260] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.007730 5317 ts_tablet_manager.cc:1428] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Time spent starting tablet: real 0.016s user 0.009s sys 0.009s
I20260806 20:34:50.009740 5083 heartbeater.cc:503] Master 127.13.149.126:35397 was elected leader, sending a full tablet report...
I20260806 20:34:50.010146 5316 ts_tablet_manager.cc:1428] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260806 20:34:50.132678 5327 raft_consensus.cc:482] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:34:50.133083 5327 raft_consensus.cc:504] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.135005 5327 leader_election.cc:288] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67:43313), b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649)
I20260806 20:34:50.135072 5325 raft_consensus.cc:482] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:34:50.135370 5325 raft_consensus.cc:504] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.137486 5325 leader_election.cc:288] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869), b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649)
W20260806 20:34:50.142335 5296 tablet.cc:2369] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:50.145984 5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.135466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43313 (local address 127.13.149.66:42625)
0806 20:34:50.136210 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.136231 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:50.136481 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:50.137067 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:50.137071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:50.137116 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:50.137583 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.137601 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.139735 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.139752 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.142237 (+ 2485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.142254 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.144933 (+ 2679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.144941 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.145217 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.145252 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 20:34:50.145344 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 20:34:50.145501 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":60,"thread_start_us":419,"threads_started":1}
I20260806 20:34:50.146728 5297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.137928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46869 (local address 127.13.149.67:49747)
0806 20:34:50.138157 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.138176 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:50.138284 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:50.139574 (+ 1290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:50.139579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:50.139603 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:50.139880 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.139892 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.141604 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.141612 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.143913 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.143928 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.145905 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.145912 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.146112 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.146148 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 20:34:50.146244 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 20:34:50.146384 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":85}
I20260806 20:34:50.147428 5309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.139056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:49747 (local address 127.13.149.66:46869)
0806 20:34:50.139242 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.139248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.139268 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:34:50.139338 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.139346 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.139419 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.139504 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:50.140075 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.141429 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.144202 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.145594 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.145738 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.145813 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.147072 (+ 1259us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.147206 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":67}
I20260806 20:34:50.146733 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.135433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:42625 (local address 127.13.149.67:43313)
0806 20:34:50.135724 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.135734 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.136334 (+ 600us) server_negotiation.cc:407] Connection header received
0806 20:34:50.136665 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.136671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.136747 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.136843 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:50.137776 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.138980 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.142442 (+ 3462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.144495 (+ 2053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.144659 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.144737 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.146324 (+ 1587us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.146463 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":505,"server-negotiator.queue_time_us":75}
I20260806 20:34:50.148041 5333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.138414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.13.149.67:55795)
0806 20:34:50.139292 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.139311 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:50.139417 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:50.140688 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:50.140692 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:50.140717 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:50.141065 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.141076 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.142981 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.142986 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.145226 (+ 2240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.145242 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.147191 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.147197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.147375 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.147415 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 20:34:50.147513 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 20:34:50.147647 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":32,"thread_start_us":1490,"threads_started":1}
I20260806 20:34:50.148959 5313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.136651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:60361 (local address 127.13.149.65:40649)
0806 20:34:50.136935 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.136943 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.139019 (+ 2076us) server_negotiation.cc:407] Connection header received
0806 20:34:50.139312 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.139319 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.139408 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.139479 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:50.140712 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.141888 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.145719 (+ 3831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.147087 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.147230 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.147300 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.148337 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.148483 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 20:34:50.148185 5334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.139370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:55795 (local address 127.13.149.65:40649)
0806 20:34:50.140130 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.140139 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.140160 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:34:50.140229 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.140235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.140317 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.140415 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:34:50.141369 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.142801 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.145424 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.146871 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.147076 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.147150 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.147564 (+ 414us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.147748 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":3682,"threads_started":1}
I20260806 20:34:50.149034 5009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4595084996934db4bc43a472f6a6c6fa" is_pre_election: true
I20260806 20:34:50.149034 5216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "4595084996934db4bc43a472f6a6c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b5f89909ced43dfb211b7e5b953eb23" is_pre_election: true
I20260806 20:34:50.149528 5009 raft_consensus.cc:2454] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b5f89909ced43dfb211b7e5b953eb23 in term 0.
I20260806 20:34:50.149518 5216 raft_consensus.cc:2454] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4595084996934db4bc43a472f6a6c6fa in term 0.
I20260806 20:34:50.150166 5331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.136348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.13.149.66:60361)
0806 20:34:50.138896 (+ 2548us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.138931 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 20:34:50.139131 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:34:50.139700 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:34:50.139703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:34:50.139730 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:34:50.140477 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.140492 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.143354 (+ 2862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.143363 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.145523 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:34:50.145536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.147497 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.147506 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:34:50.147678 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.147711 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 20:34:50.148542 (+ 831us) client_negotiation.cc:240] Negotiation successful
0806 20:34:50.149736 (+ 1194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2400,"mutex_wait_us":1,"thread_start_us":2215,"threads_started":1}
I20260806 20:34:50.150272 5115 leader_election.cc:302] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5f89909ced43dfb211b7e5b953eb23, 4595084996934db4bc43a472f6a6c6fa; no voters:
I20260806 20:34:50.150243 4919 leader_election.cc:302] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5f89909ced43dfb211b7e5b953eb23, 4595084996934db4bc43a472f6a6c6fa; no voters:
I20260806 20:34:50.150729 5327 raft_consensus.cc:2781] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:34:50.150723 5325 raft_consensus.cc:2781] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:34:50.150880 5327 raft_consensus.cc:482] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:34:50.150921 5325 raft_consensus.cc:482] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:34:50.150992 5327 raft_consensus.cc:3037] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:50.151021 5325 raft_consensus.cc:3037] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:50.151590 4825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "4595084996934db4bc43a472f6a6c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" is_pre_election: true
I20260806 20:34:50.151702 4822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" is_pre_election: true
I20260806 20:34:50.152264 4825 raft_consensus.cc:2454] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4595084996934db4bc43a472f6a6c6fa in term 0.
I20260806 20:34:50.154299 5325 raft_consensus.cc:504] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.154299 5327 raft_consensus.cc:504] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
I20260806 20:34:50.155000 5327 leader_election.cc:288] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [CANDIDATE]: Term 1 election: Requested vote from peers 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67:43313), b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649)
I20260806 20:34:50.155077 5325 leader_election.cc:288] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 election: Requested vote from peers 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869), b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649)
I20260806 20:34:50.155589 5009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4595084996934db4bc43a472f6a6c6fa"
I20260806 20:34:50.155714 4822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "1b5f89909ced43dfb211b7e5b953eb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
I20260806 20:34:50.155771 4825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "4595084996934db4bc43a472f6a6c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
I20260806 20:34:50.155881 5009 raft_consensus.cc:2379] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b5f89909ced43dfb211b7e5b953eb23 in current term 1: Already voted for candidate 4595084996934db4bc43a472f6a6c6fa in this term.
I20260806 20:34:50.155972 4822 raft_consensus.cc:3037] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:34:50.155990 5216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69c1b1d20834a99bcfdc2e9ad6baf71" candidate_uuid: "4595084996934db4bc43a472f6a6c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b5f89909ced43dfb211b7e5b953eb23"
I20260806 20:34:50.156250 5216 raft_consensus.cc:2379] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4595084996934db4bc43a472f6a6c6fa in current term 1: Already voted for candidate 1b5f89909ced43dfb211b7e5b953eb23 in this term.
I20260806 20:34:50.156826 4919 leader_election.cc:302] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4595084996934db4bc43a472f6a6c6fa; no voters: 1b5f89909ced43dfb211b7e5b953eb23, b5e4b4ec629b46178f67c0e6e20b46e0
I20260806 20:34:50.157126 5327 raft_consensus.cc:2726] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 20:34:50.158624 4822 raft_consensus.cc:2454] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b5f89909ced43dfb211b7e5b953eb23 in term 1.
I20260806 20:34:50.159009 5115 leader_election.cc:302] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b5f89909ced43dfb211b7e5b953eb23, b5e4b4ec629b46178f67c0e6e20b46e0; no voters: 4595084996934db4bc43a472f6a6c6fa
I20260806 20:34:50.159319 5325 raft_consensus.cc:2781] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:34:50.159747 5325 raft_consensus.cc:686] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 LEADER]: Becoming Leader. State: Replica: 1b5f89909ced43dfb211b7e5b953eb23, State: Running, Role: LEADER
I20260806 20:34:50.160312 5325 consensus_queue.cc:237] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } }
W20260806 20:34:50.164577 4884 tablet.cc:2369] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:50.165812 4613 catalog_manager.cc:5495] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "1b5f89909ced43dfb211b7e5b953eb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b5f89909ced43dfb211b7e5b953eb23" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 } health_report { overall_health: UNKNOWN } } }
W20260806 20:34:50.167570 5084 tablet.cc:2369] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:34:50.207696 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.202082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43860 (local address 127.13.149.67:43313)
0806 20:34:50.202309 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.202314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.202332 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:34:50.202453 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.202457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.202540 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.202667 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:34:50.203009 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.203821 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.205334 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.205784 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.205879 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.206424 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:34:50.207059 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:34:50.207181 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.207353 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.207443 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 20:34:50.217057 4822 raft_consensus.cc:1261] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Refusing update from remote peer 1b5f89909ced43dfb211b7e5b953eb23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:50.217213 5009 raft_consensus.cc:1261] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Refusing update from remote peer 1b5f89909ced43dfb211b7e5b953eb23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:34:50.218063 5335 consensus_queue.cc:1035] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e4b4ec629b46178f67c0e6e20b46e0" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 40649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:34:50.218466 5325 consensus_queue.cc:1035] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4595084996934db4bc43a472f6a6c6fa" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:34:50.230782 5339 mvcc.cc:205] Tried to move back new op lower bound from 7315654615917559808 to 7315654615701561344. Current Snapshot: MvccSnapshot[applied={T|T < 7315654615917559808}]
I20260806 20:34:50.233024 5344 mvcc.cc:205] Tried to move back new op lower bound from 7315654615917559808 to 7315654615701561344. Current Snapshot: MvccSnapshot[applied={T|T < 7315654615917559808}]
I20260806 20:34:50.245365 4613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:34:50.245698 4613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:34:50.253149 4613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Sending DeleteTablet for 3 replicas of tablet e69c1b1d20834a99bcfdc2e9ad6baf71
I20260806 20:34:50.254621 5182 tablet_service.cc:1514] Processing DeleteTablet for tablet e69c1b1d20834a99bcfdc2e9ad6baf71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:50 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:43852
I20260806 20:34:50.254905 4794 tablet_service.cc:1514] Processing DeleteTablet for tablet e69c1b1d20834a99bcfdc2e9ad6baf71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:50 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:56498
I20260806 20:34:50.254906 4985 tablet_service.cc:1514] Processing DeleteTablet for tablet e69c1b1d20834a99bcfdc2e9ad6baf71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:34:50 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:35978
I20260806 20:34:50.258306 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 4669
I20260806 20:34:50.262306 5353 tablet_replica.cc:330] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: stopping tablet replica
I20260806 20:34:50.262782 5353 raft_consensus.cc:2229] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:34:50.263440 5353 raft_consensus.cc:2258] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:50.268941 5353 ts_tablet_manager.cc:1905] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:50.271837 5358 tablet_replica.cc:330] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: stopping tablet replica
I20260806 20:34:50.272549 5358 raft_consensus.cc:2229] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:34:50.273293 5358 raft_consensus.cc:2258] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:50.274232 5356 tablet_replica.cc:330] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: stopping tablet replica
I20260806 20:34:50.276186 5358 ts_tablet_manager.cc:1905] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:50.276726 5356 raft_consensus.cc:2229] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:34:50.278610 5353 ts_tablet_manager.cc:1918] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:50.278802 5353 log.cc:1196] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/e69c1b1d20834a99bcfdc2e9ad6baf71
I20260806 20:34:50.279287 5356 raft_consensus.cc:2258] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:34:50.279465 5353 ts_tablet_manager.cc:1939] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 1b5f89909ced43dfb211b7e5b953eb23: Deleting consensus metadata
I20260806 20:34:50.281719 4594 catalog_manager.cc:4841] TS 1b5f89909ced43dfb211b7e5b953eb23 (127.13.149.67:43313): tablet e69c1b1d20834a99bcfdc2e9ad6baf71 (table test-table [id=6fc2d514d0974fec996a77332741272a]) successfully deleted
I20260806 20:34:50.283501 5356 ts_tablet_manager.cc:1905] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:50.284329 5334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.259355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56506 (local address 127.13.149.65:40649)
0806 20:34:50.259608 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.259617 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.259726 (+ 109us) server_negotiation.cc:407] Connection header received
0806 20:34:50.259964 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.259973 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.260077 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.260220 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:50.261985 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.263471 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.265550 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.266413 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.266576 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.275311 (+ 8735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:50.275329 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:50.275347 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:50.275393 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:50.279461 (+ 4068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:50.280689 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:50.280701 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:50.280705 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:50.280920 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:50.281427 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:50.281432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:50.281435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:50.281925 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:50.282294 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.283637 (+ 1343us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.283925 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:34:50.285543 4878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:50.290349 5356 ts_tablet_manager.cc:1918] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:50.290525 5356 log.cc:1196] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/e69c1b1d20834a99bcfdc2e9ad6baf71
I20260806 20:34:50.291004 5356 ts_tablet_manager.cc:1939] T e69c1b1d20834a99bcfdc2e9ad6baf71 P 4595084996934db4bc43a472f6a6c6fa: Deleting consensus metadata
I20260806 20:34:50.292548 4594 catalog_manager.cc:4841] TS 4595084996934db4bc43a472f6a6c6fa (127.13.149.66:46869): tablet e69c1b1d20834a99bcfdc2e9ad6baf71 (table test-table [id=6fc2d514d0974fec996a77332741272a]) successfully deleted
I20260806 20:34:50.422076 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 4669
W20260806 20:34:50.462252 4594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.149.65:40649 (error 108)
I20260806 20:34:50.463120 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 4892
I20260806 20:34:50.464910 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.463889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48054)
0806 20:34:50.464563 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.464675 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":445,"threads_started":1}
W20260806 20:34:50.465189 4594 catalog_manager.cc:4584] TS b5e4b4ec629b46178f67c0e6e20b46e0 (127.13.149.65:40649): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e69c1b1d20834a99bcfdc2e9ad6baf71: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
I20260806 20:34:50.479431 5309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.463968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56938 (local address 127.13.149.66:46869)
0806 20:34:50.464205 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.464215 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.464481 (+ 266us) server_negotiation.cc:407] Connection header received
0806 20:34:50.464568 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.464574 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.464657 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.464760 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:50.466864 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.467606 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.469700 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.470080 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.470174 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.473540 (+ 3366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:50.473552 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:50.473567 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:50.473598 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:50.476535 (+ 2937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:50.477444 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:50.477451 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:50.477454 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:50.477584 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:50.477980 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:50.477983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:50.477985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:50.478339 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:50.478563 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.478938 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.479102 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:34:50.480227 5077 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:50.519081 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.518509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48060)
0806 20:34:50.518764 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.518897 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260806 20:34:50.520340 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.519890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48072)
0806 20:34:50.520076 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.520166 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 20:34:50.574864 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 4892
I20260806 20:34:50.582135 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.581459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48084)
0806 20:34:50.581796 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.581922 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260806 20:34:50.584590 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.582920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48088)
0806 20:34:50.584192 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.584311 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1131,"threads_started":1}
I20260806 20:34:50.606346 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 5087
I20260806 20:34:50.621739 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.607220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50794 (local address 127.13.149.67:43313)
0806 20:34:50.607484 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 20:34:50.607491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:34:50.607600 (+ 109us) server_negotiation.cc:407] Connection header received
0806 20:34:50.607816 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:34:50.607822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:34:50.608040 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:34:50.608168 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:34:50.609692 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.610534 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.611891 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:34:50.612385 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:34:50.612530 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:34:50.615257 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:34:50.615273 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:34:50.615301 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:34:50.615336 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:34:50.618684 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:50.619486 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:50.619496 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:50.619500 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:50.619636 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:34:50.620048 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:34:50.620053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:34:50.620057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:34:50.620474 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:34:50.620996 (+ 522us) server_negotiation.cc:1035] Waiting for connection context
0806 20:34:50.621150 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 20:34:50.621399 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:34:50.622522 5288 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:50.665827 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.665141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48100)
0806 20:34:50.665409 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.665592 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260806 20:34:50.667047 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.666581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48114)
0806 20:34:50.666799 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.666910 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260806 20:34:50.751922 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 5087
I20260806 20:34:50.779075 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 4567
I20260806 20:34:50.780218 4661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:34:50.895483 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 4567
I20260806 20:34:50.895641 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:50.895070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:40649 (local address 127.0.0.1:48116)
0806 20:34:50.895283 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:50.895422 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 20:34:50.926962 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35397
--webserver_interface=127.13.149.126
--webserver_port=43875
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:35397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:51.274696 5371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:51.275032 5371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:51.275213 5371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:51.282413 5371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:34:51.282582 5371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:51.282667 5371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:51.282755 5371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:34:51.282820 5371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:34:51.292721 5371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:35397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=43875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:51.294129 5371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:51.295397 5371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:51.307605 5381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:51.307633 5382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:51.307610 5385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:51.308705 5371 server_base.cc:1034] running on GCE node
I20260806 20:34:51.309479 5371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:51.310860 5371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:51.312095 5371 hybrid_clock.cc:648] HybridClock initialized: now 1786048491312038 us; error 50 us; skew 500 ppm
I20260806 20:34:51.312443 5371 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:51 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048491, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:51.315593 5371 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:34:51.317066 5371 webserver.cc:460] Webserver started at http://127.13.149.126:43875/ using document root <none> and password file <none>
I20260806 20:34:51.317713 5371 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:51.317816 5371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:51.323149 5371 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260806 20:34:51.327891 5393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:51.329361 5371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 20:34:51.329512 5371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "cefb87e53028472fbdac79a6762b5114"
format_stamp: "Formatted at 2026-08-06 20:34:44 on dist-test-slave-2kcd"
server_key: "e7ef320296fb05e5038bc660fff80269"
server_key_iv: "9e1b46ab696462f4ae829c9f84a9ef41"
server_key_version: "encryptionkey@0"
I20260806 20:34:51.330446 5371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:51.348296 5371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:51.352396 5371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:51.352629 5371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:51.371836 5371 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:35397
I20260806 20:34:51.371863 5465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:35397 every 8 connection(s)
I20260806 20:34:51.373461 5371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:34:51.375056 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 5371
I20260806 20:34:51.375932 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:40649
--local_ip_for_outbound_sockets=127.13.149.65
--tserver_master_addrs=127.13.149.126:35397
--webserver_port=34653
--webserver_interface=127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:34:51.380610 5466 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:34:51.383879 5466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Bootstrap starting.
I20260806 20:34:51.413048 5466 log.cc:824] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Log is configured to *not* fsync() on all Append() calls
I20260806 20:34:51.435317 5466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:34:51.436048 5466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114: Bootstrap complete.
I20260806 20:34:51.450632 5466 raft_consensus.cc:348] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:51.452286 5466 raft_consensus.cc:729] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefb87e53028472fbdac79a6762b5114, State: Initialized, Role: FOLLOWER
I20260806 20:34:51.453241 5466 consensus_queue.cc:260] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:51.453603 5466 raft_consensus.cc:388] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:34:51.453763 5466 raft_consensus.cc:482] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:34:51.453990 5466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 2 FOLLOWER]: Advancing to term 3
I20260806 20:34:51.460172 5466 raft_consensus.cc:504] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:51.460826 5466 leader_election.cc:302] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cefb87e53028472fbdac79a6762b5114; no voters:
I20260806 20:34:51.461638 5466 leader_election.cc:288] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 20:34:51.461812 5477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 20:34:51.462975 5477 raft_consensus.cc:686] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [term 3 LEADER]: Becoming Leader. State: Replica: cefb87e53028472fbdac79a6762b5114, State: Running, Role: LEADER
I20260806 20:34:51.463640 5477 consensus_queue.cc:237] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } }
I20260806 20:34:51.463987 5466 sys_catalog.cc:564] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:34:51.466745 5479 sys_catalog.cc:455] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "cefb87e53028472fbdac79a6762b5114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } } }
I20260806 20:34:51.467139 5479 sys_catalog.cc:458] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:51.466399 5481 sys_catalog.cc:455] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cefb87e53028472fbdac79a6762b5114. Latest consensus state: current_term: 3 leader_uuid: "cefb87e53028472fbdac79a6762b5114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cefb87e53028472fbdac79a6762b5114" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35397 } } }
I20260806 20:34:51.467871 5481 sys_catalog.cc:458] T 00000000000000000000000000000000 P cefb87e53028472fbdac79a6762b5114 [sys.catalog]: This master's current role is: LEADER
I20260806 20:34:51.478144 5489 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:34:51.489550 5489 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:34:51.491647 5489 catalog_manager.cc:1259] Loaded cluster ID: 85c2d49eaf894862a567706d9d94b88b
I20260806 20:34:51.491854 5489 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 20:34:51.495139 5489 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9e166849ad google::LogMessage::Fail() at ??:0
@ 0x7f9e1668788a google::LogMessage::SendToLog() at ??:0
@ 0x7f9e166844de google::LogMessage::Flush() at ??:0
@ 0x7f9e16685a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9e2c0bb512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f9e2c0b8976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9e2c140610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9e2c140439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9e192d0345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9e192d391c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9e192d3799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9e192aeeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9e1c5886db start_thread at ??:0
@ 0x7f9e1551e61f clone at ??:0
W20260806 20:34:51.819936 5472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:51.820250 5472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:51.820434 5472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:51.828001 5472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:51.828145 5472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:51.828349 5472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:34:51.838646 5472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:40649
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=34653
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:51.840090 5472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:51.841553 5472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:51.856114 5535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:51.856158 5532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:51.856858 5539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:51.857033 5472 server_base.cc:1034] running on GCE node
I20260806 20:34:51.857759 5472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:51.858768 5472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:51.859982 5472 hybrid_clock.cc:648] HybridClock initialized: now 1786048491859930 us; error 39 us; skew 500 ppm
I20260806 20:34:51.860333 5472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:51 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048491, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:51.863746 5472 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:34:51.865346 5472 webserver.cc:460] Webserver started at http://127.13.149.65:34653/ using document root <none> and password file <none>
I20260806 20:34:51.866055 5472 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:51.866165 5472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:51.871652 5472 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 20:34:51.874526 5546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:51.875945 5472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:34:51.876116 5472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "b5e4b4ec629b46178f67c0e6e20b46e0"
format_stamp: "Formatted at 2026-08-06 20:34:45 on dist-test-slave-2kcd"
server_key: "794ebe482e290a24b8fb0218623b462d"
server_key_iv: "f04991092ab81a54ea488f3f309bea29"
server_key_version: "encryptionkey@0"
I20260806 20:34:51.877110 5472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:51.904894 5472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:51.909322 5472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:51.909566 5472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:51.910589 5472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:51.912518 5553 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260806 20:34:51.917950 5553 ts_tablet_manager.cc:1852] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260806 20:34:51.918991 5553 ts_tablet_manager.cc:1905] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:34:51.926226 5553 ts_tablet_manager.cc:1918] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:34:51.926447 5553 log.cc:1196] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/e69c1b1d20834a99bcfdc2e9ad6baf71
I20260806 20:34:51.926975 5553 ts_tablet_manager.cc:1939] T e69c1b1d20834a99bcfdc2e9ad6baf71 P b5e4b4ec629b46178f67c0e6e20b46e0: Deleting consensus metadata
I20260806 20:34:51.927390 5472 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260806 20:34:51.927541 5472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260806 20:34:51.927686 5472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:51.927783 5472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:51.961768 5472 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:40649
I20260806 20:34:51.961820 5721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:40649 every 8 connection(s)
I20260806 20:34:51.963188 5472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:34:51.968580 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:51.966397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:46071)
0806 20:34:51.967324 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:51.967644 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":391,"threads_started":1}
W20260806 20:34:51.969280 5722 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:35397 (0 consecutive failures): Network error: Failed to ping master at 127.13.149.126:35397: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
I20260806 20:34:51.970059 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:51.969741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:60681)
0806 20:34:51.969888 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:51.969954 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 20:34:51.970916 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:51.970570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:36953)
0806 20:34:51.970720 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:51.970803 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:34:51.971163 5722 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 20:34:51.973187 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 5472
I20260806 20:34:51.973793 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:46869
--local_ip_for_outbound_sockets=127.13.149.66
--tserver_master_addrs=127.13.149.126:35397
--webserver_port=45969
--webserver_interface=127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:52.320585 5726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:52.320856 5726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:52.320952 5726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:52.327787 5726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:52.327884 5726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:52.328100 5726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:34:52.337563 5726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:46869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=45969
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:52.338730 5726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:52.340027 5726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:52.353580 5737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:52.353668 5733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:52.353642 5735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:52.354413 5726 server_base.cc:1034] running on GCE node
I20260806 20:34:52.354959 5726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:52.355872 5726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:52.357090 5726 hybrid_clock.cc:648] HybridClock initialized: now 1786048492357045 us; error 24 us; skew 500 ppm
I20260806 20:34:52.357376 5726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:52 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048492, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:52.360477 5726 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:34:52.362077 5726 webserver.cc:460] Webserver started at http://127.13.149.66:45969/ using document root <none> and password file <none>
I20260806 20:34:52.362703 5726 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:52.362809 5726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:52.367931 5726 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 20:34:52.370606 5745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:52.371892 5726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:34:52.372080 5726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "4595084996934db4bc43a472f6a6c6fa"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "b09975ea11b9b9c8283e790a06146212"
server_key_iv: "88e6673f3260fb989d1089a2a7f212eb"
server_key_version: "encryptionkey@0"
I20260806 20:34:52.373134 5726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:52.384619 5726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:52.388464 5726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:52.388759 5726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:52.389782 5726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:52.391093 5726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:52.391180 5726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:52.391328 5726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:52.391420 5726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:52.426723 5726 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:46869
I20260806 20:34:52.426832 5929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:46869 every 8 connection(s)
I20260806 20:34:52.428258 5726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:34:52.432968 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 5726
I20260806 20:34:52.433301 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:52.431287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:49947)
0806 20:34:52.432054 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:52.432265 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":306,"threads_started":1}
I20260806 20:34:52.433753 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:43313
--local_ip_for_outbound_sockets=127.13.149.67
--tserver_master_addrs=127.13.149.126:35397
--webserver_port=42021
--webserver_interface=127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:34:52.434121 5931 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:35397 (0 consecutive failures): Network error: Failed to ping master at 127.13.149.126:35397: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
I20260806 20:34:52.435077 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:52.434710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:48015)
0806 20:34:52.434880 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:52.434968 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 20:34:52.436017 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:52.435698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:32809)
0806 20:34:52.435835 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:52.435914 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 20:34:52.436326 5931 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 20:34:52.770641 5934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:34:52.770941 5934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:34:52.771042 5934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:34:52.778313 5934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:34:52.778417 5934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:34:52.778538 5934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:34:52.788196 5934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:43313
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=42021
--tserver_master_addrs=127.13.149.126:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:34:52.789479 5934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:34:52.790777 5934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:34:52.803977 5942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:52.804013 5943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:34:52.804061 5947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:34:52.804893 5934 server_base.cc:1034] running on GCE node
I20260806 20:34:52.805481 5934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:34:52.806417 5934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:34:52.807647 5934 hybrid_clock.cc:648] HybridClock initialized: now 1786048492807607 us; error 57 us; skew 500 ppm
I20260806 20:34:52.808064 5934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:34:52 dist-test-slave-2kcd krb5kdc[3737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048492, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:34:52.811386 5934 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:34:52.812906 5934 webserver.cc:460] Webserver started at http://127.13.149.67:42021/ using document root <none> and password file <none>
I20260806 20:34:52.813563 5934 fs_manager.cc:359] Metadata directory not provided
I20260806 20:34:52.813670 5934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:34:52.818936 5934 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260806 20:34:52.821550 5957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:52.822832 5934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:34:52.823015 5934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "1b5f89909ced43dfb211b7e5b953eb23"
format_stamp: "Formatted at 2026-08-06 20:34:46 on dist-test-slave-2kcd"
server_key: "4d832b22d85f476222f49bc5db8fadf3"
server_key_iv: "bee4751add639486d57030b1ea28840a"
server_key_version: "encryptionkey@0"
I20260806 20:34:52.823987 5934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:34:52.845546 5934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:34:52.849619 5934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:34:52.849900 5934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:34:52.850863 5934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:34:52.852262 5934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:34:52.852375 5934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:52.852509 5934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:34:52.852609 5934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:34:52.888361 5934 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:43313
I20260806 20:34:52.888456 6131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:43313 every 8 connection(s)
I20260806 20:34:52.889961 5934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:34:52.893112 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 5934
I20260806 20:34:52.895444 6135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:52.893183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:60285)
0806 20:34:52.894104 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:52.894412 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":373,"threads_started":1}
W20260806 20:34:52.896102 6132 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:35397 (0 consecutive failures): Network error: Failed to ping master at 127.13.149.126:35397: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
I20260806 20:34:52.896971 6135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:52.896603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:46903)
0806 20:34:52.896744 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:52.896865 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 20:34:52.897764 6135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:52.897477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:36477)
0806 20:34:52.897594 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:52.897665 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 20:34:52.897997 6132 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 20:34:52.972640 6138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:52.971709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:49645)
0806 20:34:52.972163 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:52.972339 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":234,"threads_started":1}
I20260806 20:34:53.437721 6139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:53.436913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:46549)
0806 20:34:53.437371 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:53.437475 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":220,"threads_started":1}
I20260806 20:34:53.899432 6140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:53.898569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:55553)
0806 20:34:53.899065 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:53.899193 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":221,"threads_started":1}
I20260806 20:34:53.974277 6142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:53.973596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:35579)
0806 20:34:53.974043 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:53.974126 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":222,"threads_started":1}
I20260806 20:34:54.439390 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:54.438714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:42951)
0806 20:34:54.439152 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:54.439229 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":218,"threads_started":1}
I20260806 20:34:54.901165 6144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:54.900387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:46911)
0806 20:34:54.900906 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:54.900996 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":238,"threads_started":1}
I20260806 20:34:54.976095 6146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:54.975278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:51533)
0806 20:34:54.975753 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:54.975838 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":235,"threads_started":1}
I20260806 20:34:55.441147 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:55.440274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:60159)
0806 20:34:55.440884 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:55.440964 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":371,"threads_started":1}
I20260806 20:34:55.902750 6149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:55.901952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:35089)
0806 20:34:55.902477 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:55.902575 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":297,"threads_started":1}
I20260806 20:34:55.977865 6150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:55.977046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:53025)
0806 20:34:55.977572 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:55.977696 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":298,"threads_started":1}
I20260806 20:34:56.442656 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:56.441958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:32943)
0806 20:34:56.442395 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:56.442471 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":213,"threads_started":1}
I20260806 20:34:56.904482 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:56.903757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:34521)
0806 20:34:56.904208 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:56.904290 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":222,"threads_started":1}
I20260806 20:34:56.979576 6153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:56.978835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:39477)
0806 20:34:56.979309 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:56.979390 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":245,"threads_started":1}
I20260806 20:34:57.444199 6154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:57.443513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:40195)
0806 20:34:57.443952 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:57.444031 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":234,"threads_started":1}
I20260806 20:34:57.906075 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:57.905355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:52199)
0806 20:34:57.905827 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:57.905910 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":251,"threads_started":1}
I20260806 20:34:57.981472 6158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:57.980532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:49397)
0806 20:34:57.981148 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:57.981242 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":356,"threads_started":1}
I20260806 20:34:58.445815 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:58.445053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:40447)
0806 20:34:58.445544 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:58.445637 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":259,"threads_started":1}
I20260806 20:34:58.907639 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:58.906954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:38031)
0806 20:34:58.907385 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:58.907475 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":220,"threads_started":1}
I20260806 20:34:58.983170 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:58.982341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:53783)
0806 20:34:58.982861 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:58.982943 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":232,"threads_started":1}
I20260806 20:34:59.447666 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:59.446794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:53179)
0806 20:34:59.447334 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:59.447428 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":263,"threads_started":1}
I20260806 20:34:59.909409 6163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:59.908534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:53473)
0806 20:34:59.909086 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:59.909170 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":267,"threads_started":1}
I20260806 20:34:59.984736 6164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:34:59.984032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:38163)
0806 20:34:59.984497 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 20:34:59.984576 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":269,"threads_started":1}
I20260806 20:35:00.449359 6165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:00.448576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:43869)
0806 20:35:00.449119 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:00.449199 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":323,"threads_started":1}
I20260806 20:35:00.911098 6167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:00.910393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:42107)
0806 20:35:00.910843 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:00.910935 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":230,"threads_started":1}
I20260806 20:35:00.986482 6168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:00.985690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:60835)
0806 20:35:00.986206 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:00.986304 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":270,"threads_started":1}
I20260806 20:35:01.451107 6169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:01.450292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:53309)
0806 20:35:01.450801 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:01.450911 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":254,"threads_started":1}
I20260806 20:35:01.912753 6170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:01.912019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:33611)
0806 20:35:01.912488 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:01.912570 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":226,"threads_started":1}
I20260806 20:35:01.988106 6171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:01.987392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:36317)
0806 20:35:01.987846 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:01.987931 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":243,"threads_started":1}
I20260806 20:35:02.453017 6172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:02.452193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:58843)
0806 20:35:02.452736 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:02.452846 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":299,"threads_started":1}
I20260806 20:35:02.914848 6177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:02.913925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:57623)
0806 20:35:02.914574 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:02.914670 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":385,"threads_started":1}
I20260806 20:35:02.990151 6179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:02.989258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:46701)
0806 20:35:02.989835 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:02.989941 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":316,"threads_started":1}
I20260806 20:35:03.454777 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:03.454032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:39653)
0806 20:35:03.454496 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:03.454581 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":218,"threads_started":1}
I20260806 20:35:03.916808 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:03.915952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:52167)
0806 20:35:03.916468 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:03.916577 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":255,"threads_started":1}
I20260806 20:35:03.991933 6187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:03.991138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:41277)
0806 20:35:03.991635 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:03.991737 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":267,"threads_started":1}
I20260806 20:35:04.456669 6189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:04.455893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:38855)
0806 20:35:04.456410 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:04.456503 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":263,"threads_started":1}
I20260806 20:35:04.918525 6190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:04.917849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:43549)
0806 20:35:04.918288 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:04.918370 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":242,"threads_started":1}
I20260806 20:35:04.993664 6192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:04.992907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:42137)
0806 20:35:04.993381 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:04.993479 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":228,"threads_started":1}
I20260806 20:35:05.458400 6193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:05.457633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:49689)
0806 20:35:05.458106 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:05.458220 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":227,"threads_started":1}
I20260806 20:35:05.920410 6195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:05.919403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:32835)
0806 20:35:05.919996 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:05.920125 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":266,"threads_started":1}
I20260806 20:35:05.995290 6197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:05.994571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:40193)
0806 20:35:05.995014 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:05.995098 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":226,"threads_started":1}
I20260806 20:35:06.460168 6198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:06.459391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:37709)
0806 20:35:06.459858 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:06.459969 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":237,"threads_started":1}
I20260806 20:35:06.922093 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:06.921386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:39051)
0806 20:35:06.921809 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:06.921890 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":222,"threads_started":1}
I20260806 20:35:06.997241 6201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:06.996422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.65:47225)
0806 20:35:06.996920 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:06.997054 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":223,"threads_started":1}
I20260806 20:35:07.462410 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:07.461495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.66:35463)
0806 20:35:07.462038 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:07.462164 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":278,"threads_started":1}
I20260806 20:35:07.905342 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 5472
I20260806 20:35:07.924070 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:07.923217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:35397 (local address 127.13.149.67:48097)
0806 20:35:07.923740 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:07.923857 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:35397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":291,"threads_started":1}
I20260806 20:35:07.924963 6204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:07.906517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53170 (local address 127.13.149.65:40649)
0806 20:35:07.907196 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:07.907214 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:07.907270 (+ 56us) server_negotiation.cc:407] Connection header received
0806 20:35:07.909674 (+ 2404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:07.909684 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:07.910125 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:07.910439 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:07.911977 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:07.913264 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:07.914549 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:07.915255 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:07.915409 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:07.918414 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:07.918422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:07.918436 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:07.918474 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:07.921581 (+ 3107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:07.922225 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:07.922231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:07.922237 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:07.922406 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:07.922791 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:07.922796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:07.922799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:07.923368 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:07.923695 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:07.924170 (+ 475us) server_negotiation.cc:299] Negotiation successful
0806 20:35:07.924618 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":319,"threads_started":1}
I20260806 20:35:07.926319 5714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:08.014289 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 5472
I20260806 20:35:08.041711 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 5726
I20260806 20:35:08.058838 6208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:08.042787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34454 (local address 127.13.149.66:46869)
0806 20:35:08.043363 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:08.043378 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:08.043419 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:35:08.045017 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:08.045027 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:08.045452 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:08.045751 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:08.047121 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:08.048331 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:08.049612 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:08.050282 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:08.050411 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:08.052986 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:08.052993 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:08.053006 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:08.053046 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:08.055838 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:08.056510 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:08.056517 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:08.056523 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:08.056686 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:08.057145 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:08.057148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:08.057150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:08.057628 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:08.057858 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:08.058234 (+ 376us) server_negotiation.cc:299] Negotiation successful
0806 20:35:08.058545 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":292,"threads_started":1}
I20260806 20:35:08.060236 5917 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:08.145253 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 5726
I20260806 20:35:08.173919 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 5934
I20260806 20:35:08.193622 6210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:08.175219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34872 (local address 127.13.149.67:43313)
0806 20:35:08.175934 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:08.175952 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:08.176010 (+ 58us) server_negotiation.cc:407] Connection header received
0806 20:35:08.177897 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:08.177908 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:08.178339 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:08.178645 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:08.180087 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:08.181411 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:08.182717 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:08.183381 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:08.183519 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:08.187096 (+ 3577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:08.187108 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:08.187128 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:08.187202 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:08.190263 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:08.190968 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:08.190977 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:08.190986 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:08.191162 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:08.191544 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:08.191549 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:08.191552 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:08.192078 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:08.192394 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:08.192875 (+ 481us) server_negotiation.cc:299] Negotiation successful
0806 20:35:08.193304 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":325,"threads_started":1}
I20260806 20:35:08.195060 6120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:08.286931 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 5934
2026-08-06T20:35:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25361 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:35:08 dist-test-slave-2kcd krb5kdc[6218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:35:08 dist-test-slave-2kcd krb5kdc[6218](info): set up 2 sockets
Aug 06 20:35:08 dist-test-slave-2kcd krb5kdc[6218](info): commencing operation
krb5kdc: starting...
W20260806 20:35:09.619243 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:35:09 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:35:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:35:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:35:09.911485 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41689
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:41689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:35:10.259469 6241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:10.259745 6241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:10.259918 6241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:10.267226 6241 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 20:35:10.267318 6241 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 20:35:10.267412 6241 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 20:35:10.267503 6241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:35:10.267596 6241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:10.267691 6241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:10.267764 6241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:35:10.267841 6241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:35:10.277581 6241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:41689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:10.278817 6241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:10.280133 6241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:10.292091 6248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:10.292016 6253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:10.292047 6251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:10.293143 6241 server_base.cc:1034] running on GCE node
I20260806 20:35:10.293838 6241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:10.295068 6241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:10.296279 6241 hybrid_clock.cc:648] HybridClock initialized: now 1786048510296202 us; error 47 us; skew 500 ppm
I20260806 20:35:10.296631 6241 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:10 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048510, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:10.302714 6241 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:35:10.304075 6241 webserver.cc:460] Webserver started at http://127.13.149.126:33185/ using document root <none> and password file <none>
I20260806 20:35:10.304752 6241 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:10.304917 6241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:10.305259 6241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:35:10.308148 6241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "ba5e281137c440ca8efdf694efd8dbd4"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "5b85665afeba9ba9c371967a3698aaf9"
server_key_iv: "8b2fed4fe16739d345eb665518b057b3"
server_key_version: "encryptionkey@0"
I20260806 20:35:10.308996 6241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "ba5e281137c440ca8efdf694efd8dbd4"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "5b85665afeba9ba9c371967a3698aaf9"
server_key_iv: "8b2fed4fe16739d345eb665518b057b3"
server_key_version: "encryptionkey@0"
I20260806 20:35:10.313997 6241 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:35:10.317663 6261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:10.318956 6241 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:35:10.319144 6241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "ba5e281137c440ca8efdf694efd8dbd4"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "5b85665afeba9ba9c371967a3698aaf9"
server_key_iv: "8b2fed4fe16739d345eb665518b057b3"
server_key_version: "encryptionkey@0"
I20260806 20:35:10.319360 6241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:10.338378 6241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:10.342605 6241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:10.342864 6241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:10.361826 6241 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:41689
I20260806 20:35:10.361861 6336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:41689 every 8 connection(s)
I20260806 20:35:10.363129 6241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:35:10.366765 6339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:35:10.367357 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 6241
I20260806 20:35:10.367578 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:35:10.368271 13909 external_mini_cluster.cc:1428] Setting key 71af4c70d490b183e95bbc501cb280d3
I20260806 20:35:10.380674 6339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Bootstrap starting.
Aug 06 20:35:10 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:35:10.384423 6339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Neither blocks nor log segments found. Creating new log.
I20260806 20:35:10.385609 6339 log.cc:824] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:10.388401 6339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: No bootstrap required, opened a new log
I20260806 20:35:10.391987 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:10.370266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42236 (local address 127.13.149.126:41689)
0806 20:35:10.371188 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:10.371201 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:10.371242 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:35:10.372926 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:10.372948 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:10.373304 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:10.373618 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:10.375610 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:10.376906 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:10.378852 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:10.379489 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:10.379634 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:10.384599 (+ 4965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:10.384608 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:10.384626 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:10.384661 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:10.387753 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:10.388434 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:10.388441 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:10.388446 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:10.388669 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:10.389097 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:10.389103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:10.389106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:10.389741 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:10.390057 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:10.390532 (+ 475us) server_negotiation.cc:299] Negotiation successful
0806 20:35:10.390950 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":409,"threads_started":1}
I20260806 20:35:10.396495 6339 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:10.396898 6339 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:35:10.397006 6339 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5e281137c440ca8efdf694efd8dbd4, State: Initialized, Role: FOLLOWER
I20260806 20:35:10.397529 6339 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:10.397790 6339 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:35:10.397934 6339 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:35:10.398108 6339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:35:10.400450 6339 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:10.401023 6339 leader_election.cc:302] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba5e281137c440ca8efdf694efd8dbd4; no voters:
I20260806 20:35:10.401652 6339 leader_election.cc:288] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:35:10.401782 6347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:35:10.402490 6347 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 LEADER]: Becoming Leader. State: Replica: ba5e281137c440ca8efdf694efd8dbd4, State: Running, Role: LEADER
I20260806 20:35:10.403081 6347 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:10.403746 6339 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:35:10.406116 6349 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba5e281137c440ca8efdf694efd8dbd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } } }
I20260806 20:35:10.406049 6350 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba5e281137c440ca8efdf694efd8dbd4. Latest consensus state: current_term: 1 leader_uuid: "ba5e281137c440ca8efdf694efd8dbd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } } }
I20260806 20:35:10.406535 6349 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:35:10.406574 6350 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:35:10.414134 6355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:35:10.419389 6355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:35:10.428308 6355 catalog_manager.cc:1347] Generated new cluster ID: 5cfa127c97a745999fa4e5776273ff79
I20260806 20:35:10.428412 6355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:35:10.447207 6355 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:35:10.448505 6355 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:35:10.455128 6355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Generated new TSK 0
I20260806 20:35:10.455926 6355 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:35:10.536371 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41689
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:35:10.880301 6375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:10.880582 6375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:10.880748 6375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:10.888134 6375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:10.888259 6375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:10.888441 6375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:35:10.898344 6375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:10.899614 6375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:10.901031 6375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:10.913960 6381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:10.913923 6386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:10.914171 6389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:10.915064 6375 server_base.cc:1034] running on GCE node
I20260806 20:35:10.915659 6375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:10.916549 6375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:10.917775 6375 hybrid_clock.cc:648] HybridClock initialized: now 1786048510917684 us; error 99 us; skew 500 ppm
I20260806 20:35:10.918092 6375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:10 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048510, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:10.921267 6375 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:35:10.922700 6375 webserver.cc:460] Webserver started at http://127.13.149.65:34093/ using document root <none> and password file <none>
I20260806 20:35:10.923393 6375 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:10.923520 6375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:10.923885 6375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:35:10.926944 6375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "9ab694a45f2144ddb96d67142789c8f3"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "95db77650465daf12ea109988cade800"
server_key_iv: "b1a161cd4c2b915effc5b20bed831199"
server_key_version: "encryptionkey@0"
I20260806 20:35:10.927709 6375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "9ab694a45f2144ddb96d67142789c8f3"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "95db77650465daf12ea109988cade800"
server_key_iv: "b1a161cd4c2b915effc5b20bed831199"
server_key_version: "encryptionkey@0"
I20260806 20:35:10.933071 6375 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 20:35:10.936547 6400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:10.937897 6375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:35:10.938086 6375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "9ab694a45f2144ddb96d67142789c8f3"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "95db77650465daf12ea109988cade800"
server_key_iv: "b1a161cd4c2b915effc5b20bed831199"
server_key_version: "encryptionkey@0"
I20260806 20:35:10.938298 6375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:10.951349 6375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:10.955996 6375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:10.956287 6375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:10.957365 6375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:10.958683 6375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:35:10.958757 6375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:10.958920 6375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:10.958979 6375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:10.993276 6375 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:35249
I20260806 20:35:10.993319 6593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:35249 every 8 connection(s)
I20260806 20:35:10.994624 6375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:35:10.995234 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 6375
I20260806 20:35:10.995473 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:35:10.996131 13909 external_mini_cluster.cc:1428] Setting key bff15d4f2e4ff0db048b23b2a687c22a
Aug 06 20:35:11 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048510, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:35:11.015882 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:10.997689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:49987 (local address 127.13.149.126:41689)
0806 20:35:10.998214 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:10.998220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:10.999242 (+ 1022us) server_negotiation.cc:407] Connection header received
0806 20:35:11.001149 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:11.001154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:11.001239 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:11.001352 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:11.002807 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.003545 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.005217 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.005623 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.005754 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:11.009430 (+ 3676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:11.009439 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:11.009447 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:11.009490 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:11.012340 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:11.013294 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:11.013298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:11.013300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:11.013421 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:11.013903 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:11.013907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:11.013909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:11.014404 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:11.014616 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:11.015436 (+ 820us) server_negotiation.cc:299] Negotiation successful
0806 20:35:11.015607 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":239,"threads_started":1}
I20260806 20:35:11.017343 6599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:10.998321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:49987)
0806 20:35:10.999089 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:10.999132 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:11.000894 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:11.001584 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:11.001592 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:11.002084 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:35:11.002635 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:11.002652 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.003714 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.003719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:11.005074 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:11.005086 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.005855 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.005865 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:11.006093 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:11.006763 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:35:11.006785 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:35:11.009213 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:35:11.012485 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:11.012496 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:11.012512 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:11.013176 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:11.013519 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:11.013526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:11.013532 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:11.013781 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:11.014575 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:35:11.014586 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:35:11.015039 (+ 453us) client_negotiation.cc:769] Sending connection context
0806 20:35:11.015331 (+ 292us) client_negotiation.cc:240] Negotiation successful
0806 20:35:11.015879 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":326,"threads_started":1}
I20260806 20:35:11.018968 6594 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41689
I20260806 20:35:11.019268 6594 heartbeater.cc:464] Registering TS with master...
I20260806 20:35:11.020045 6594 heartbeater.cc:511] Master 127.13.149.126:41689 requested a full tablet report, sending...
I20260806 20:35:11.022656 6285 ts_manager.cc:194] Registered new tserver with Master: 9ab694a45f2144ddb96d67142789c8f3 (127.13.149.65:35249)
I20260806 20:35:11.024899 6285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:49987
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:35:11.063346 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41689
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:35:11.405457 6602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:11.405733 6602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:11.405926 6602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:11.413055 6602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:11.413169 6602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:11.413338 6602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:35:11.422909 6602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:11.424125 6602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:11.425343 6602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:11.438475 6610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:11.438392 6611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:11.438359 6613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:11.439172 6602 server_base.cc:1034] running on GCE node
I20260806 20:35:11.439762 6602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:11.440688 6602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:11.441917 6602 hybrid_clock.cc:648] HybridClock initialized: now 1786048511441875 us; error 63 us; skew 500 ppm
I20260806 20:35:11.442286 6602 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:11 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048511, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:11.445519 6602 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:35:11.446935 6602 webserver.cc:460] Webserver started at http://127.13.149.66:41017/ using document root <none> and password file <none>
I20260806 20:35:11.447628 6602 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:11.447772 6602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:11.448096 6602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:35:11.451050 6602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "b3529383ee65491e84a8cf189c01a06a"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "1d4424c73a8c4978522652648cb647e8"
server_key_iv: "481b7345fb63d9e3c101ada0550e5bf5"
server_key_version: "encryptionkey@0"
I20260806 20:35:11.451799 6602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "b3529383ee65491e84a8cf189c01a06a"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "1d4424c73a8c4978522652648cb647e8"
server_key_iv: "481b7345fb63d9e3c101ada0550e5bf5"
server_key_version: "encryptionkey@0"
I20260806 20:35:11.457134 6602 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:35:11.460342 6623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:11.461644 6602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:35:11.461817 6602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "b3529383ee65491e84a8cf189c01a06a"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "1d4424c73a8c4978522652648cb647e8"
server_key_iv: "481b7345fb63d9e3c101ada0550e5bf5"
server_key_version: "encryptionkey@0"
I20260806 20:35:11.462030 6602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:11.484844 6602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:11.489456 6602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:11.489754 6602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:11.490703 6602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:11.492107 6602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:35:11.492206 6602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:11.492352 6602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:11.492419 6602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:11.525942 6602 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:33879
I20260806 20:35:11.525976 6808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:33879 every 8 connection(s)
I20260806 20:35:11.527184 6602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:35:11.529572 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 6602
I20260806 20:35:11.529803 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:35:11.530267 13909 external_mini_cluster.cc:1428] Setting key 376e0eed10a66352780c784ea69c6dc2
Aug 06 20:35:11 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048511, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:35:11.550194 6813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:11.529713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:55699 (local address 127.13.149.126:41689)
0806 20:35:11.531148 (+ 1435us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:11.531154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:11.531794 (+ 640us) server_negotiation.cc:407] Connection header received
0806 20:35:11.534380 (+ 2586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:11.534384 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:11.534447 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:11.534552 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:11.536591 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.537357 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.539772 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.540187 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.540278 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:11.544515 (+ 4237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:11.544520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:11.544523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:11.544554 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:11.547191 (+ 2637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:11.547892 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:11.547899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:11.547902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:11.548038 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:11.548459 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:11.548464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:11.548468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:11.548757 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:11.548956 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:11.549606 (+ 650us) server_negotiation.cc:299] Negotiation successful
0806 20:35:11.549829 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1284,"thread_start_us":1185,"threads_started":1}
I20260806 20:35:11.551086 6814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:11.530412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:55699)
0806 20:35:11.531621 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:11.531665 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:11.534107 (+ 2442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:11.534822 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:11.534836 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:11.535635 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:35:11.536406 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:11.536433 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.537517 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.537524 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:11.539632 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:11.539650 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:11.540406 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:11.540415 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:11.540745 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:11.541539 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:35:11.541562 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:35:11.544297 (+ 2735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:35:11.547338 (+ 3041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:11.547346 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:11.547364 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:11.547770 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:11.548150 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:11.548154 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:11.548158 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:11.548346 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:11.548942 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:35:11.548950 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:35:11.549249 (+ 299us) client_negotiation.cc:769] Sending connection context
0806 20:35:11.549506 (+ 257us) client_negotiation.cc:240] Negotiation successful
0806 20:35:11.550018 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":915,"thread_start_us":647,"threads_started":1}
I20260806 20:35:11.552410 6809 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41689
I20260806 20:35:11.552709 6809 heartbeater.cc:464] Registering TS with master...
I20260806 20:35:11.553411 6809 heartbeater.cc:511] Master 127.13.149.126:41689 requested a full tablet report, sending...
I20260806 20:35:11.554884 6285 ts_manager.cc:194] Registered new tserver with Master: b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879)
I20260806 20:35:11.555704 6285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:55699
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:35:11.600080 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41689
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:35:11.938856 6817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:11.939113 6817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:11.939208 6817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:11.946538 6817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:11.946645 6817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:11.946758 6817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:35:11.956118 6817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:11.957369 6817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:11.958649 6817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:11.972054 6823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:11.972026 6824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:11.972604 6827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:11.973182 6817 server_base.cc:1034] running on GCE node
I20260806 20:35:11.973765 6817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:11.974733 6817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:11.976042 6817 hybrid_clock.cc:648] HybridClock initialized: now 1786048511975987 us; error 60 us; skew 500 ppm
I20260806 20:35:11.976378 6817 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:11 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048511, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:11.979687 6817 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:35:11.981210 6817 webserver.cc:460] Webserver started at http://127.13.149.67:38641/ using document root <none> and password file <none>
I20260806 20:35:11.981933 6817 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:11.982081 6817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:11.982400 6817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:35:11.985419 6817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "785a3965d1394c5698ae78088f2b249e"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "6022254e5a6c5902f4a47eec4b372cb2"
server_key_iv: "50fac73a0504f8316fa16aa80b55edcd"
server_key_version: "encryptionkey@0"
I20260806 20:35:11.986191 6817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "785a3965d1394c5698ae78088f2b249e"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "6022254e5a6c5902f4a47eec4b372cb2"
server_key_iv: "50fac73a0504f8316fa16aa80b55edcd"
server_key_version: "encryptionkey@0"
I20260806 20:35:11.991581 6817 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:35:11.995605 6835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:11.997104 6817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 20:35:11.997257 6817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "785a3965d1394c5698ae78088f2b249e"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "6022254e5a6c5902f4a47eec4b372cb2"
server_key_iv: "50fac73a0504f8316fa16aa80b55edcd"
server_key_version: "encryptionkey@0"
I20260806 20:35:11.997444 6817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:12.025228 6817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:12.027845 6594 heartbeater.cc:503] Master 127.13.149.126:41689 was elected leader, sending a full tablet report...
I20260806 20:35:12.030014 6817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:12.030273 6817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:12.031190 6817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:12.032464 6817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:35:12.032542 6817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:12.032632 6817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:12.032676 6817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:12.066365 6817 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:45937
I20260806 20:35:12.066416 7017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:45937 every 8 connection(s)
I20260806 20:35:12.067687 6817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:35:12.070139 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 6817
I20260806 20:35:12.070387 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:35:12.070992 13909 external_mini_cluster.cc:1428] Setting key 4a080f6470467328de8e54c6611d0698
Aug 06 20:35:12 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048511, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:35:12.088316 7020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.070377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:52019 (local address 127.13.149.126:41689)
0806 20:35:12.070927 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.070933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.072186 (+ 1253us) server_negotiation.cc:407] Connection header received
0806 20:35:12.074122 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.074126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.074190 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.074280 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:12.075770 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.076546 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.078125 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.078566 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.078667 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.082169 (+ 3502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:12.082174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:12.082178 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:12.082209 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:12.085155 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.085988 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.085993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.085997 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.086134 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.086569 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.086574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.086578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.086851 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:12.087011 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.087694 (+ 683us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.087920 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":256,"threads_started":1}
I20260806 20:35:12.089352 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.071176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:52019)
0806 20:35:12.072036 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.072092 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:12.073873 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:12.074526 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:12.074536 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:12.075053 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:35:12.075619 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.075635 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.076670 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.076674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.077977 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.077994 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.078769 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.078773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.078974 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.079673 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:35:12.079698 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:35:12.081974 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:35:12.085278 (+ 3304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:12.085287 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:12.085303 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:12.085866 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:12.086241 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:12.086246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:12.086250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:12.086448 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:12.086980 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:35:12.086988 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:35:12.087327 (+ 339us) client_negotiation.cc:769] Sending connection context
0806 20:35:12.087602 (+ 275us) client_negotiation.cc:240] Negotiation successful
0806 20:35:12.088133 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":361,"threads_started":1}
I20260806 20:35:12.090709 7018 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41689
I20260806 20:35:12.091027 7018 heartbeater.cc:464] Registering TS with master...
I20260806 20:35:12.091740 7018 heartbeater.cc:511] Master 127.13.149.126:41689 requested a full tablet report, sending...
I20260806 20:35:12.093192 6285 ts_manager.cc:194] Registered new tserver with Master: 785a3965d1394c5698ae78088f2b249e (127.13.149.67:45937)
I20260806 20:35:12.094012 6285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:52019
I20260806 20:35:12.098528 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:35:12.116282 7020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.103400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39724 (local address 127.13.149.126:41689)
0806 20:35:12.103587 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.103591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.104111 (+ 520us) server_negotiation.cc:407] Connection header received
0806 20:35:12.104262 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.104266 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.104338 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.104421 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:12.105970 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.106676 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.107997 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.108401 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.108500 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.110973 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:12.110978 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:12.110981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:12.111013 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:12.113573 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.114285 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.114291 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.114294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.114447 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.114828 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.114833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.114837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.115160 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:12.115410 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.115752 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.115975 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:35:12.120260 6285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:35:12.127334 6285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:35:12.167692 7042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.140058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46902 (local address 127.13.149.66:33879)
0806 20:35:12.158689 (+ 18631us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.158699 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.158728 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:35:12.158827 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.158834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.159130 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.160030 (+ 900us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:12.160295 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.161970 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.164690 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.166341 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.166487 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.166708 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.167137 (+ 429us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.167318 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18444,"thread_start_us":18317,"threads_started":1}
I20260806 20:35:12.167747 7035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.139603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:33879 (local address 127.0.0.1:46902)
0806 20:35:12.158046 (+ 18443us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.158063 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:12.158160 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:12.159396 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:12.159406 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:12.159468 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:12.159843 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.159859 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.162117 (+ 2258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.162122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.164524 (+ 2402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.164537 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.166535 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.166542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.166759 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.166830 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 20:35:12.167092 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 20:35:12.167300 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18324,"mutex_wait_us":59,"thread_start_us":13034,"threads_started":1}
I20260806 20:35:12.168771 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.138966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:45937 (local address 127.0.0.1:38692)
0806 20:35:12.152112 (+ 13146us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.152178 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:12.152404 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:12.160055 (+ 7651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:12.160063 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:12.160103 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:12.160606 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.160617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.163293 (+ 2676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.163301 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.165301 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.165317 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.167867 (+ 2550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.167874 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.168048 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.168082 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 20:35:12.168154 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 20:35:12.168291 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12800,"mutex_wait_us":2,"thread_start_us":18805,"threads_started":1}
I20260806 20:35:12.169531 7037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.139357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38692 (local address 127.13.149.67:45937)
0806 20:35:12.159433 (+ 20076us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.159440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.159473 (+ 33us) server_negotiation.cc:407] Connection header received
0806 20:35:12.159566 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.159576 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.159804 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.160027 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:12.160847 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.163154 (+ 2307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.166064 (+ 2910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.167628 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.168550 (+ 922us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.168769 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.168863 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.169040 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19902,"thread_start_us":19732,"threads_started":1}
I20260806 20:35:12.170219 7036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.139351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38570)
0806 20:35:12.157309 (+ 17958us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.157335 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:12.157504 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:12.161363 (+ 3859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:12.161369 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:12.161397 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:12.161793 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.161803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.164209 (+ 2406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.164214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.166709 (+ 2495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.166724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.168736 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.168746 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.168947 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.168982 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 20:35:12.169053 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 20:35:12.169815 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17790,"thread_start_us":17659,"threads_started":1}
I20260806 20:35:12.171221 7040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.139715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38570 (local address 127.13.149.65:35249)
0806 20:35:12.160776 (+ 21061us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.160810 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.160839 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:35:12.160944 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.160951 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.161147 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.162102 (+ 955us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:12.162477 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.164039 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.166932 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.168461 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.170478 (+ 2017us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.170698 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.170764 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.170914 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20869,"thread_start_us":20717,"threads_started":1}
I20260806 20:35:12.172309 6700 tablet_service.cc:1467] Processing CreateTablet for tablet 7109aa95f2774decb1c0ec88d945ceb1 (DEFAULT_TABLE table=test-table [id=86d804340caf45898005ae6abbd4b6df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:35:12.172765 6903 tablet_service.cc:1467] Processing CreateTablet for tablet 7109aa95f2774decb1c0ec88d945ceb1 (DEFAULT_TABLE table=test-table [id=86d804340caf45898005ae6abbd4b6df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:35:12.173633 6700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7109aa95f2774decb1c0ec88d945ceb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:35:12.174772 6903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7109aa95f2774decb1c0ec88d945ceb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:35:12.174687 6480 tablet_service.cc:1467] Processing CreateTablet for tablet 7109aa95f2774decb1c0ec88d945ceb1 (DEFAULT_TABLE table=test-table [id=86d804340caf45898005ae6abbd4b6df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:35:12.176074 6480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7109aa95f2774decb1c0ec88d945ceb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:35:12.184950 7043 tablet_bootstrap.cc:492] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Bootstrap starting.
I20260806 20:35:12.188382 7043 tablet_bootstrap.cc:654] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Neither blocks nor log segments found. Creating new log.
I20260806 20:35:12.189508 7044 tablet_bootstrap.cc:492] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Bootstrap starting.
I20260806 20:35:12.189738 7043 log.cc:824] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:12.191057 7045 tablet_bootstrap.cc:492] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Bootstrap starting.
I20260806 20:35:12.193022 7044 tablet_bootstrap.cc:654] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Neither blocks nor log segments found. Creating new log.
I20260806 20:35:12.194128 7045 tablet_bootstrap.cc:654] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Neither blocks nor log segments found. Creating new log.
I20260806 20:35:12.194289 7043 tablet_bootstrap.cc:492] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: No bootstrap required, opened a new log
I20260806 20:35:12.194247 7044 log.cc:824] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:12.194561 7043 ts_tablet_manager.cc:1397] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260806 20:35:12.195318 7045 log.cc:824] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:12.197325 7044 tablet_bootstrap.cc:492] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: No bootstrap required, opened a new log
I20260806 20:35:12.197563 7044 ts_tablet_manager.cc:1397] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260806 20:35:12.205320 7043 raft_consensus.cc:348] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.205775 7043 raft_consensus.cc:374] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:35:12.205878 7043 raft_consensus.cc:729] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3529383ee65491e84a8cf189c01a06a, State: Initialized, Role: FOLLOWER
I20260806 20:35:12.206612 7043 consensus_queue.cc:260] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.209617 7044 raft_consensus.cc:348] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.210171 7044 raft_consensus.cc:374] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:35:12.210295 7044 raft_consensus.cc:729] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 785a3965d1394c5698ae78088f2b249e, State: Initialized, Role: FOLLOWER
I20260806 20:35:12.211017 7044 consensus_queue.cc:260] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.212234 7018 heartbeater.cc:503] Master 127.13.149.126:41689 was elected leader, sending a full tablet report...
I20260806 20:35:12.214051 7044 ts_tablet_manager.cc:1428] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Time spent starting tablet: real 0.016s user 0.008s sys 0.006s
I20260806 20:35:12.214641 7043 ts_tablet_manager.cc:1428] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Time spent starting tablet: real 0.020s user 0.013s sys 0.007s
I20260806 20:35:12.214664 7045 tablet_bootstrap.cc:492] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: No bootstrap required, opened a new log
I20260806 20:35:12.214946 7045 ts_tablet_manager.cc:1397] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.014s
I20260806 20:35:12.215085 6809 heartbeater.cc:503] Master 127.13.149.126:41689 was elected leader, sending a full tablet report...
I20260806 20:35:12.223312 7045 raft_consensus.cc:348] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.223634 7045 raft_consensus.cc:374] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:35:12.223704 7045 raft_consensus.cc:729] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab694a45f2144ddb96d67142789c8f3, State: Initialized, Role: FOLLOWER
I20260806 20:35:12.224275 7045 consensus_queue.cc:260] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.227519 7045 ts_tablet_manager.cc:1428] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
W20260806 20:35:12.248528 6595 tablet.cc:2369] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:35:12.279330 6812 tablet.cc:2369] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:35:12.319617 7019 tablet.cc:2369] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:35:12.396051 7055 raft_consensus.cc:482] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:35:12.396387 7055 raft_consensus.cc:504] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.398233 7055 leader_election.cc:288] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 785a3965d1394c5698ae78088f2b249e (127.13.149.67:45937), b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879)
I20260806 20:35:12.406661 7042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.398896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:60575 (local address 127.13.149.66:33879)
0806 20:35:12.399141 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.399150 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.399826 (+ 676us) server_negotiation.cc:407] Connection header received
0806 20:35:12.400044 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.400050 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.400116 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.400212 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:12.400875 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.401711 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.404139 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.405433 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.405583 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.405656 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.406256 (+ 600us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.406389 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 20:35:12.406661 7037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.398521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:33073 (local address 127.13.149.67:45937)
0806 20:35:12.398763 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.398773 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.399474 (+ 701us) server_negotiation.cc:407] Connection header received
0806 20:35:12.399714 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.399719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.399782 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.399876 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:12.400442 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.401334 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.404039 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.405408 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.405581 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.405656 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.406259 (+ 603us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.406389 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:35:12.406919 7056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.398434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:45937 (local address 127.13.149.65:33073)
0806 20:35:12.399357 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.399373 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:12.399564 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:12.399896 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:12.399900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:12.399925 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:12.400276 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.400285 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.401460 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.401469 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.403879 (+ 2410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.403895 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.405690 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.405701 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.406025 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.406113 (+ 88us) client_negotiation.cc:769] Sending connection context
0806 20:35:12.406209 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 20:35:12.406413 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":184,"thread_start_us":598,"threads_started":1}
I20260806 20:35:12.406942 7057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.398718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:33879 (local address 127.13.149.65:60575)
0806 20:35:12.399717 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.399731 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:12.399874 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:12.400233 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:12.400237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:12.400270 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:12.400678 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.400687 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.401870 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.401875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.403992 (+ 2117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:12.404007 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.405716 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.405722 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:12.405989 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.406118 (+ 129us) client_negotiation.cc:769] Sending connection context
0806 20:35:12.406211 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 20:35:12.406413 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"mutex_wait_us":145,"thread_start_us":637,"threads_started":1}
I20260806 20:35:12.407905 6930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7109aa95f2774decb1c0ec88d945ceb1" candidate_uuid: "9ab694a45f2144ddb96d67142789c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "785a3965d1394c5698ae78088f2b249e" is_pre_election: true
I20260806 20:35:12.407969 6730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7109aa95f2774decb1c0ec88d945ceb1" candidate_uuid: "9ab694a45f2144ddb96d67142789c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3529383ee65491e84a8cf189c01a06a" is_pre_election: true
I20260806 20:35:12.408398 6930 raft_consensus.cc:2454] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab694a45f2144ddb96d67142789c8f3 in term 0.
I20260806 20:35:12.408445 6730 raft_consensus.cc:2454] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab694a45f2144ddb96d67142789c8f3 in term 0.
I20260806 20:35:12.409080 6406 leader_election.cc:302] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab694a45f2144ddb96d67142789c8f3, b3529383ee65491e84a8cf189c01a06a; no voters:
I20260806 20:35:12.409489 7055 raft_consensus.cc:2781] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:35:12.409634 7055 raft_consensus.cc:482] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:35:12.409739 7055 raft_consensus.cc:3037] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:35:12.411936 7055 raft_consensus.cc:504] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.412623 7055 leader_election.cc:288] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 785a3965d1394c5698ae78088f2b249e (127.13.149.67:45937), b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879)
I20260806 20:35:12.413058 6930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7109aa95f2774decb1c0ec88d945ceb1" candidate_uuid: "9ab694a45f2144ddb96d67142789c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "785a3965d1394c5698ae78088f2b249e"
I20260806 20:35:12.413204 6730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7109aa95f2774decb1c0ec88d945ceb1" candidate_uuid: "9ab694a45f2144ddb96d67142789c8f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3529383ee65491e84a8cf189c01a06a"
I20260806 20:35:12.413276 6930 raft_consensus.cc:3037] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:35:12.413421 6730 raft_consensus.cc:3037] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:35:12.416551 6730 raft_consensus.cc:2454] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab694a45f2144ddb96d67142789c8f3 in term 1.
I20260806 20:35:12.416551 6930 raft_consensus.cc:2454] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab694a45f2144ddb96d67142789c8f3 in term 1.
I20260806 20:35:12.416980 6406 leader_election.cc:302] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 785a3965d1394c5698ae78088f2b249e, 9ab694a45f2144ddb96d67142789c8f3, b3529383ee65491e84a8cf189c01a06a; no voters:
I20260806 20:35:12.417285 7055 raft_consensus.cc:2781] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:35:12.417749 7055 raft_consensus.cc:686] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab694a45f2144ddb96d67142789c8f3, State: Running, Role: LEADER
I20260806 20:35:12.418213 7055 consensus_queue.cc:237] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } }
I20260806 20:35:12.423023 6283 catalog_manager.cc:5495] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab694a45f2144ddb96d67142789c8f3 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "9ab694a45f2144ddb96d67142789c8f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } health_report { overall_health: UNKNOWN } } }
I20260806 20:35:12.464314 7040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.458902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38574 (local address 127.13.149.65:35249)
0806 20:35:12.459139 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.459144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.459163 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:35:12.459353 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.459356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.459437 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.459563 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:35:12.459937 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.460640 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.462032 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.462522 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.462641 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.463125 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:35:12.463663 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:35:12.463795 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.463886 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.463960 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:35:12.473101 6730 raft_consensus.cc:1261] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Refusing update from remote peer 9ab694a45f2144ddb96d67142789c8f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:35:12.473106 6930 raft_consensus.cc:1261] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 1 FOLLOWER]: Refusing update from remote peer 9ab694a45f2144ddb96d67142789c8f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:35:12.474110 7055 consensus_queue.cc:1035] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:35:12.474434 7058 consensus_queue.cc:1035] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:35:12.491140 7065 mvcc.cc:205] Tried to move back new op lower bound from 7315654707079639040 to 7315654706868424704. Current Snapshot: MvccSnapshot[applied={T|T < 7315654707079639040 or (T in {7315654707079639040})}]
I20260806 20:35:12.504236 6285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:35:12.504513 6285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:35:12.508260 6285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Sending DeleteTablet for 3 replicas of tablet 7109aa95f2774decb1c0ec88d945ceb1
I20260806 20:35:12.509511 6903 tablet_service.cc:1514] Processing DeleteTablet for tablet 7109aa95f2774decb1c0ec88d945ceb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:35:12 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:38692
I20260806 20:35:12.509733 6700 tablet_service.cc:1514] Processing DeleteTablet for tablet 7109aa95f2774decb1c0ec88d945ceb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:35:12 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:46902
I20260806 20:35:12.509859 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 6375
I20260806 20:35:12.510190 6480 tablet_service.cc:1514] Processing DeleteTablet for tablet 7109aa95f2774decb1c0ec88d945ceb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:35:12 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:38570
I20260806 20:35:12.531117 7077 tablet_replica.cc:330] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: stopping tablet replica
I20260806 20:35:12.531673 7077 raft_consensus.cc:2229] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:35:12.532270 7077 raft_consensus.cc:2258] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 06 20:35:12 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:35:12.540920 7078 tablet_replica.cc:330] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: stopping tablet replica
I20260806 20:35:12.541190 7077 ts_tablet_manager.cc:1905] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:12.541405 7078 raft_consensus.cc:2229] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:35:12.542250 7078 raft_consensus.cc:2258] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:35:12.542682 7076 tablet_replica.cc:330] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: stopping tablet replica
I20260806 20:35:12.543073 7076 raft_consensus.cc:2229] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:35:12.543536 7076 raft_consensus.cc:2258] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:35:12.545607 7076 ts_tablet_manager.cc:1905] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:12.550602 7078 ts_tablet_manager.cc:1905] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:12.553323 7076 ts_tablet_manager.cc:1918] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:35:12.553495 7076 log.cc:1196] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/7109aa95f2774decb1c0ec88d945ceb1
I20260806 20:35:12.554031 7076 ts_tablet_manager.cc:1939] T 7109aa95f2774decb1c0ec88d945ceb1 P 785a3965d1394c5698ae78088f2b249e: Deleting consensus metadata
I20260806 20:35:12.555855 6264 catalog_manager.cc:4841] TS 785a3965d1394c5698ae78088f2b249e (127.13.149.67:45937): tablet 7109aa95f2774decb1c0ec88d945ceb1 (table test-table [id=86d804340caf45898005ae6abbd4b6df]) successfully deleted
I20260806 20:35:12.552574 7077 ts_tablet_manager.cc:1918] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:35:12.558043 7077 log.cc:1196] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/7109aa95f2774decb1c0ec88d945ceb1
I20260806 20:35:12.558590 7077 ts_tablet_manager.cc:1939] T 7109aa95f2774decb1c0ec88d945ceb1 P b3529383ee65491e84a8cf189c01a06a: Deleting consensus metadata
I20260806 20:35:12.559906 7040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.511233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.13.149.65:35249)
0806 20:35:12.511455 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.511462 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.522166 (+ 10704us) server_negotiation.cc:407] Connection header received
0806 20:35:12.522858 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.522868 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.522991 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.523090 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:12.526279 (+ 3189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.527903 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.532715 (+ 4812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.533666 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.533802 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.550260 (+ 16458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:12.550275 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:12.550292 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:12.550355 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:12.554624 (+ 4269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.555622 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.556180 (+ 558us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.556184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.556387 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.556917 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.556923 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.556926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.557412 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:12.557734 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.559046 (+ 1312us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.559309 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 20:35:12.560459 6267 catalog_manager.cc:4841] TS b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879): tablet 7109aa95f2774decb1c0ec88d945ceb1 (table test-table [id=86d804340caf45898005ae6abbd4b6df]) successfully deleted
I20260806 20:35:12.560752 6587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:12.659722 7078 ts_tablet_manager.cc:1918] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:35:12.660070 7078 log.cc:1196] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/7109aa95f2774decb1c0ec88d945ceb1
I20260806 20:35:12.660458 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 6375
W20260806 20:35:12.686036 6265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.149.65:35249 (error 108)
I20260806 20:35:12.686549 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 6602
I20260806 20:35:12.688246 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.687419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38588)
0806 20:35:12.687868 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.688013 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":205,"threads_started":1}
W20260806 20:35:12.688468 6265 catalog_manager.cc:4584] TS 9ab694a45f2144ddb96d67142789c8f3 (127.13.149.65:35249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7109aa95f2774decb1c0ec88d945ceb1: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Aug 06 20:35:12 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:35:12.702081 7042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.687407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.13.149.66:33879)
0806 20:35:12.687692 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.687698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.687721 (+ 23us) server_negotiation.cc:407] Connection header received
0806 20:35:12.687911 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.687917 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.688005 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.688118 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:12.689585 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.690323 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.691619 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.691998 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.692095 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.696324 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:12.696336 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:12.696351 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:12.696387 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:12.699408 (+ 3021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.700099 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.700105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.700108 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.700283 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.700607 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.700610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.700612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.701139 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:12.701419 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.701668 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.701828 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260806 20:35:12.702745 6800 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:12.742228 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.741679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38604)
0806 20:35:12.741908 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.742055 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 20:35:12.743450 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.743011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38618)
0806 20:35:12.743189 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.743279 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 20:35:12.793346 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 6602
I20260806 20:35:12.803977 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.803372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38626)
0806 20:35:12.803644 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.803766 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260806 20:35:12.805282 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.804822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38642)
0806 20:35:12.804990 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.805088 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 20:35:12.820169 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 6817
Aug 06 20:35:12 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:35:12.836251 7037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.820965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38702 (local address 127.13.149.67:45937)
0806 20:35:12.821151 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:12.821158 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:12.821250 (+ 92us) server_negotiation.cc:407] Connection header received
0806 20:35:12.821466 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:12.821471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:12.821545 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:12.821653 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:12.823429 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.824194 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.825746 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:12.826152 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:12.826290 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:12.830673 (+ 4383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:12.830688 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:12.830705 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:12.830743 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:12.833402 (+ 2659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.834098 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.834106 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.834108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.834256 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:12.834681 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:12.834685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:12.834687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:12.835038 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:12.835351 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:12.835686 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 20:35:12.835911 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:35:12.837049 7004 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:12.886368 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.885764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38648)
0806 20:35:12.886059 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.886172 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260806 20:35:12.887611 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:12.887119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38658)
0806 20:35:12.887357 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:12.887443 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260806 20:35:12.927158 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 6817
I20260806 20:35:12.951951 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 6241
I20260806 20:35:12.953195 6331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:13.064534 7088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:13.064078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:38672)
0806 20:35:13.064250 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:13.064346 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 20:35:13.064606 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 6241
I20260806 20:35:33.094892 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41689
--webserver_interface=127.13.149.126
--webserver_port=33185
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:41689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:35:33.443259 7095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:33.443534 7095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:33.443624 7095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:33.450871 7095 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 20:35:33.450976 7095 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 20:35:33.451016 7095 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 20:35:33.451062 7095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:35:33.451117 7095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:33.451185 7095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:33.451232 7095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:35:33.451280 7095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:35:33.460904 7095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:41689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=33185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:33.462126 7095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:33.463392 7095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:33.489256 7106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:33.489324 7109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:33.489367 7107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:33.489643 7095 server_base.cc:1034] running on GCE node
I20260806 20:35:33.490844 7095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:33.492504 7095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:33.493784 7095 hybrid_clock.cc:648] HybridClock initialized: now 1786048533493660 us; error 88 us; skew 500 ppm
I20260806 20:35:33.494220 7095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:33 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048533, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:33.503252 7095 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:35:33.505126 7095 webserver.cc:460] Webserver started at http://127.13.149.126:33185/ using document root <none> and password file <none>
I20260806 20:35:33.506039 7095 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:33.506197 7095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:33.512457 7095 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260806 20:35:33.515693 7128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:33.517347 7095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:35:33.517555 7095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "ba5e281137c440ca8efdf694efd8dbd4"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "5b85665afeba9ba9c371967a3698aaf9"
server_key_iv: "8b2fed4fe16739d345eb665518b057b3"
server_key_version: "encryptionkey@0"
I20260806 20:35:33.518690 7095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:33.536576 7095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:33.540930 7095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:33.541257 7095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:33.561889 7095 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:41689
I20260806 20:35:33.561908 7203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:41689 every 8 connection(s)
I20260806 20:35:33.563719 7095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:35:33.567165 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 7095
I20260806 20:35:33.568106 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:35249
--local_ip_for_outbound_sockets=127.13.149.65
--tserver_master_addrs=127.13.149.126:41689
--webserver_port=34093
--webserver_interface=127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:35:33.571169 7204 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:35:33.574586 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Bootstrap starting.
I20260806 20:35:33.600304 7204 log.cc:824] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:33.616961 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:35:33.617641 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Bootstrap complete.
I20260806 20:35:33.631608 7204 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:33.632809 7204 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5e281137c440ca8efdf694efd8dbd4, State: Initialized, Role: FOLLOWER
I20260806 20:35:33.633554 7204 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:33.633854 7204 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:35:33.634007 7204 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:35:33.634193 7204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 1 FOLLOWER]: Advancing to term 2
I20260806 20:35:33.640229 7204 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:33.640890 7204 leader_election.cc:302] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba5e281137c440ca8efdf694efd8dbd4; no voters:
I20260806 20:35:33.641563 7204 leader_election.cc:288] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 20:35:33.641734 7208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 20:35:33.643138 7208 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 LEADER]: Becoming Leader. State: Replica: ba5e281137c440ca8efdf694efd8dbd4, State: Running, Role: LEADER
I20260806 20:35:33.643828 7204 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:35:33.643711 7208 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:33.646137 7213 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba5e281137c440ca8efdf694efd8dbd4. Latest consensus state: current_term: 2 leader_uuid: "ba5e281137c440ca8efdf694efd8dbd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } } }
I20260806 20:35:33.646582 7213 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:35:33.647239 7209 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ba5e281137c440ca8efdf694efd8dbd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } } }
I20260806 20:35:33.647626 7209 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:35:33.654623 7218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:35:33.663033 7218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:35:33.664458 7218 catalog_manager.cc:1259] Loaded cluster ID: 5cfa127c97a745999fa4e5776273ff79
I20260806 20:35:33.664605 7218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:35:33.668679 7218 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:35:33.670565 7218 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Loaded TSK: 0
I20260806 20:35:33.705181 7218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Generated new TSK 1
I20260806 20:35:33.705603 7218 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 20:35:33.981206 7206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:33.981480 7206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:33.981637 7206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:33.989002 7206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:33.989112 7206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:33.989274 7206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:35:33.999082 7206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:35249
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=34093
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:34.000530 7206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:34.002043 7206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:34.017158 7247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:34.017156 7248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:34.017661 7250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:34.018151 7206 server_base.cc:1034] running on GCE node
I20260806 20:35:34.018811 7206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:34.019924 7206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:34.021155 7206 hybrid_clock.cc:648] HybridClock initialized: now 1786048534021091 us; error 58 us; skew 500 ppm
I20260806 20:35:34.021510 7206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:34 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048534, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:34.025436 7206 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:35:34.027065 7206 webserver.cc:460] Webserver started at http://127.13.149.65:34093/ using document root <none> and password file <none>
I20260806 20:35:34.027882 7206 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:34.028040 7206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:34.035006 7206 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 20:35:34.038424 7263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:34.040067 7206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:35:34.040258 7206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "9ab694a45f2144ddb96d67142789c8f3"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "95db77650465daf12ea109988cade800"
server_key_iv: "b1a161cd4c2b915effc5b20bed831199"
server_key_version: "encryptionkey@0"
I20260806 20:35:34.041719 7206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:34.066542 7206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:34.071461 7206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:34.071748 7206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:34.072890 7206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:34.074939 7274 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260806 20:35:34.080116 7274 ts_tablet_manager.cc:1852] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260806 20:35:34.081161 7274 ts_tablet_manager.cc:1905] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:34.088142 7274 ts_tablet_manager.cc:1918] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:35:34.088433 7274 ts_tablet_manager.cc:1939] T 7109aa95f2774decb1c0ec88d945ceb1 P 9ab694a45f2144ddb96d67142789c8f3: Deleting consensus metadata
I20260806 20:35:34.088883 7206 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260806 20:35:34.089004 7206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.014s user 0.001s sys 0.000s
I20260806 20:35:34.089148 7206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:34.089226 7206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:34.123778 7206 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:35249
I20260806 20:35:34.123873 7444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:35249 every 8 connection(s)
I20260806 20:35:34.125134 7206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:35:34.133078 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 7206
I20260806 20:35:34.133853 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:33879
--local_ip_for_outbound_sockets=127.13.149.66
--tserver_master_addrs=127.13.149.126:41689
--webserver_port=41017
--webserver_interface=127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:35:34 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048534, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:35:34.151226 7448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:34.128059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:55347 (local address 127.13.149.126:41689)
0806 20:35:34.128628 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:34.128641 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:34.129405 (+ 764us) server_negotiation.cc:407] Connection header received
0806 20:35:34.131523 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:34.131534 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:34.131837 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:34.132131 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:34.133660 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.135746 (+ 2086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.137407 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.138473 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.138675 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:34.142260 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:34.142272 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:34.142293 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:34.142353 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:34.146665 (+ 4312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:34.147690 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:34.147697 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:34.147703 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:34.147862 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:34.148351 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:34.148354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:34.148356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:34.148915 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:34.149122 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:34.149994 (+ 872us) server_negotiation.cc:299] Negotiation successful
0806 20:35:34.150299 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":244,"threads_started":1}
I20260806 20:35:34.151733 7449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:34.128295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:55347)
0806 20:35:34.129239 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:34.129285 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:34.131064 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:34.132256 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:34.132263 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:34.132764 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:35:34.133418 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:34.133437 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.135941 (+ 2504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.135945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:34.137264 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:34.137277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.138686 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.138691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:34.138870 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:34.139565 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:35:34.139586 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:35:34.141958 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:35:34.146820 (+ 4862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:34.146831 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:34.146848 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:34.147547 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:34.147983 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:34.147989 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:34.147994 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:34.148233 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:34.149074 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:35:34.149084 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:35:34.149522 (+ 438us) client_negotiation.cc:769] Sending connection context
0806 20:35:34.149806 (+ 284us) client_negotiation.cc:240] Negotiation successful
0806 20:35:34.150366 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":434,"threads_started":1}
I20260806 20:35:34.154772 7445 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41689
I20260806 20:35:34.155136 7445 heartbeater.cc:464] Registering TS with master...
I20260806 20:35:34.155900 7445 heartbeater.cc:511] Master 127.13.149.126:41689 requested a full tablet report, sending...
I20260806 20:35:34.158396 7154 ts_manager.cc:194] Registered new tserver with Master: 9ab694a45f2144ddb96d67142789c8f3 (127.13.149.65:35249)
I20260806 20:35:34.160671 7154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:55347
W20260806 20:35:34.483016 7453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:34.483269 7453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:34.483362 7453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:34.490574 7453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:34.490674 7453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:34.490782 7453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:35:34.499980 7453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:33879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=41017
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:34.501238 7453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:34.502507 7453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:34.515210 7463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:34.515165 7464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:34.515264 7468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:34.516003 7453 server_base.cc:1034] running on GCE node
I20260806 20:35:34.516637 7453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:34.517597 7453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:34.518827 7453 hybrid_clock.cc:648] HybridClock initialized: now 1786048534518793 us; error 43 us; skew 500 ppm
I20260806 20:35:34.519133 7453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:34 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048534, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:34.522236 7453 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:35:34.523664 7453 webserver.cc:460] Webserver started at http://127.13.149.66:41017/ using document root <none> and password file <none>
I20260806 20:35:34.524333 7453 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:34.524458 7453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:34.529562 7453 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:35:34.532150 7479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:34.533463 7453 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:35:34.533597 7453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "b3529383ee65491e84a8cf189c01a06a"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "1d4424c73a8c4978522652648cb647e8"
server_key_iv: "481b7345fb63d9e3c101ada0550e5bf5"
server_key_version: "encryptionkey@0"
I20260806 20:35:34.534502 7453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:34.555619 7453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:34.559600 7453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:34.559835 7453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:34.560868 7453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:34.562592 7453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:35:34.562726 7453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:34.562829 7453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:34.562908 7453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:34.599900 7453 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:33879
I20260806 20:35:34.599942 7651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:33879 every 8 connection(s)
I20260806 20:35:34.601428 7453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:35:34.610342 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 7453
I20260806 20:35:34.611050 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:45937
--local_ip_for_outbound_sockets=127.13.149.67
--tserver_master_addrs=127.13.149.126:41689
--webserver_port=38641
--webserver_interface=127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 20:35:34 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048534, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:35:34.624035 7448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:34.604007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:56713 (local address 127.13.149.126:41689)
0806 20:35:34.604207 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:34.604212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:34.605381 (+ 1169us) server_negotiation.cc:407] Connection header received
0806 20:35:34.607172 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:34.607177 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:34.607260 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:34.607364 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:34.608896 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.609640 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.611602 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.612550 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.612707 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:34.616683 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:34.616692 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:34.616699 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:34.616759 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:34.620391 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:34.621268 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:34.621276 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:34.621282 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:34.621436 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:34.621880 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:34.621887 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:34.621893 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:34.622370 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:34.622539 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:34.623283 (+ 744us) server_negotiation.cc:299] Negotiation successful
0806 20:35:34.623566 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:35:34.624909 7656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:34.604479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:56713)
0806 20:35:34.605220 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:34.605257 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:34.606913 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:34.607578 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:34.607586 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:34.608082 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:35:34.608640 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:34.608657 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.609850 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.609855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:34.611437 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:34.611452 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:34.612872 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:34.612883 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:34.613138 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:34.613877 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:35:34.613907 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:35:34.616416 (+ 2509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:35:34.620556 (+ 4140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:34.620563 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:34.620576 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:34.621142 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:34.621566 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:34.621570 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:34.621572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:34.621761 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:34.622514 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:35:34.622521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:35:34.622879 (+ 358us) client_negotiation.cc:769] Sending connection context
0806 20:35:34.623183 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 20:35:34.623676 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":322,"threads_started":1}
I20260806 20:35:34.626498 7654 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41689
I20260806 20:35:34.626857 7654 heartbeater.cc:464] Registering TS with master...
I20260806 20:35:34.627617 7654 heartbeater.cc:511] Master 127.13.149.126:41689 requested a full tablet report, sending...
I20260806 20:35:34.629122 7154 ts_manager.cc:194] Registered new tserver with Master: b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879)
I20260806 20:35:34.629951 7154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:56713
W20260806 20:35:34.955295 7657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:34.955615 7657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:34.955783 7657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:34.962954 7657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:34.963094 7657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:34.963281 7657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:35:34.972589 7657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:45937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=38641
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:34.973882 7657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:34.975167 7657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:34.988201 7664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:34.988754 7671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:34.988801 7666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:34.989143 7657 server_base.cc:1034] running on GCE node
I20260806 20:35:34.989806 7657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:34.990911 7657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:34.992153 7657 hybrid_clock.cc:648] HybridClock initialized: now 1786048534992111 us; error 38 us; skew 500 ppm
I20260806 20:35:34.992488 7657 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:34 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048534, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:34.995858 7657 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:35:34.997344 7657 webserver.cc:460] Webserver started at http://127.13.149.67:38641/ using document root <none> and password file <none>
I20260806 20:35:34.998034 7657 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:34.998200 7657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:35.003667 7657 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260806 20:35:35.006371 7680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:35.007692 7657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:35:35.007893 7657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "785a3965d1394c5698ae78088f2b249e"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "6022254e5a6c5902f4a47eec4b372cb2"
server_key_iv: "50fac73a0504f8316fa16aa80b55edcd"
server_key_version: "encryptionkey@0"
I20260806 20:35:35.008947 7657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:35.030674 7657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:35.034741 7657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:35.035014 7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:35.035981 7657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:35.037457 7657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:35:35.037599 7657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:35.037724 7657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:35.037879 7657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:35.073040 7657 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:45937
I20260806 20:35:35.073099 7864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:45937 every 8 connection(s)
I20260806 20:35:35.074599 7657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:35:35.084844 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 7657
Aug 06 20:35:35 dist-test-slave-2kcd krb5kdc[6218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048534, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:35:35.096937 7448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.077363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:50147 (local address 127.13.149.126:41689)
0806 20:35:35.077592 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.077596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.078666 (+ 1070us) server_negotiation.cc:407] Connection header received
0806 20:35:35.080532 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.080537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.080630 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.080748 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:35.082305 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.083050 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.084605 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.085154 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.085295 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.089566 (+ 4271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:35.089573 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:35.089577 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:35.089615 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:35.093075 (+ 3460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.094066 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.094070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.094072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.094216 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.094752 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.094755 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.094757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.095060 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:35.095176 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.096177 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.096448 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"spinlock_wait_cycles":1408}
I20260806 20:35:35.097941 7867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.077773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:50147)
0806 20:35:35.078499 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.078537 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:35.080246 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:35.081029 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:35.081038 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:35.081560 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:35:35.082124 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.082142 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.083232 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.083236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.084452 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.084465 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.085409 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.085418 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.085709 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.086561 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:35:35.086603 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:35:35.089339 (+ 2736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:35:35.093213 (+ 3874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:35.093223 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:35.093242 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:35.093916 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:35.094347 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:35:35.094351 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:35:35.094355 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:35:35.094625 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:35:35.095203 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:35:35.095213 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:35:35.095699 (+ 486us) client_negotiation.cc:769] Sending connection context
0806 20:35:35.096041 (+ 342us) client_negotiation.cc:240] Negotiation successful
0806 20:35:35.096468 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":277,"threads_started":1}
I20260806 20:35:35.099550 7865 heartbeater.cc:347] Connected to a master server at 127.13.149.126:41689
I20260806 20:35:35.099891 7865 heartbeater.cc:464] Registering TS with master...
I20260806 20:35:35.100823 7865 heartbeater.cc:511] Master 127.13.149.126:41689 requested a full tablet report, sending...
I20260806 20:35:35.102794 7154 ts_manager.cc:194] Registered new tserver with Master: 785a3965d1394c5698ae78088f2b249e (127.13.149.67:45937)
I20260806 20:35:35.102845 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.085831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48224 (local address 127.13.149.126:41689)
0806 20:35:35.086496 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.086502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.086910 (+ 408us) server_negotiation.cc:407] Connection header received
0806 20:35:35.087124 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.087127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.087187 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.087278 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:35.089297 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.090533 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.091995 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.092715 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.092873 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.096143 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:35.096149 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:35.096153 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:35.096184 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:35.099646 (+ 3462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.100495 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.100502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.100506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.100664 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.101213 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.101219 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.101222 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.101594 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:35.101841 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.102263 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.102472 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":331,"threads_started":1}
I20260806 20:35:35.103889 7154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:50147
I20260806 20:35:35.105726 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:35:35.112761 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.106920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.13.149.126:41689)
0806 20:35:35.107128 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.107133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.107467 (+ 334us) server_negotiation.cc:407] Connection header received
0806 20:35:35.107635 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.107638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.107753 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.107866 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:35:35.108237 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.109028 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.110856 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.111284 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.111389 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.111944 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:35:35.112232 (+ 288us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 20:35:35.112569 (+ 337us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48236: token expired
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 20:35:35.112941 7869 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48236: token expired
W20260806 20:35:35.113574 7024 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.13.149.126:41689)
I20260806 20:35:35.126506 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.114016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48246 (local address 127.13.149.126:41689)
0806 20:35:35.114159 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.114163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.114238 (+ 75us) server_negotiation.cc:407] Connection header received
0806 20:35:35.114341 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.114344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.114394 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.114472 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:35.115799 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.116490 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.117799 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.118203 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.118300 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.120898 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:35.120904 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:35.120909 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:35.120961 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:35.123753 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.124523 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.124532 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.124534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.124662 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.125071 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.125076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.125079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.125367 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:35.125624 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.125968 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.126179 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 20:35:35.130184 7154 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48246:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:35:35.137425 7154 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:35:35.163902 7445 heartbeater.cc:503] Master 127.13.149.126:41689 was elected leader, sending a full tablet report...
I20260806 20:35:35.173694 7886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.149432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:33879 (local address 127.0.0.1:47936)
0806 20:35:35.161411 (+ 11979us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.161484 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:35.161721 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:35.165078 (+ 3357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:35.165087 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:35.165112 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:35.165586 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.165601 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.167511 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.167517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.170572 (+ 3055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.170590 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.172560 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.172568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.172864 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.172916 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 20:35:35.173040 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 20:35:35.173220 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11651,"mutex_wait_us":46,"thread_start_us":16201,"threads_started":1}
I20260806 20:35:35.174047 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.149875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47936 (local address 127.13.149.66:33879)
0806 20:35:35.159805 (+ 9930us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.159819 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.161988 (+ 2169us) server_negotiation.cc:407] Connection header received
0806 20:35:35.162125 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.162137 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.162465 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.162698 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:35.165825 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.167357 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.170772 (+ 3415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.172270 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.172418 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.172644 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.173141 (+ 497us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.173529 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9756,"thread_start_us":9623,"threads_started":1}
I20260806 20:35:35.175347 7880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.149487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54808)
0806 20:35:35.164982 (+ 15495us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.165004 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:35.165108 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:35.167611 (+ 2503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:35.167619 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:35.167652 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:35.168097 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.168108 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.170230 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.170236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.172635 (+ 2399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.172652 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.174408 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.174414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.174745 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.174778 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 20:35:35.174862 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 20:35:35.174990 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15319,"mutex_wait_us":102,"thread_start_us":18726,"threads_started":1}
I20260806 20:35:35.175413 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.149774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54808 (local address 127.13.149.65:35249)
0806 20:35:35.166920 (+ 17146us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.166931 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.166980 (+ 49us) server_negotiation.cc:407] Connection header received
0806 20:35:35.167089 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.167099 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.167377 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.167616 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:35.168315 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.170056 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.172801 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.174210 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.174344 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.174585 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.174936 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.175104 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16924,"thread_start_us":18061,"threads_started":1}
I20260806 20:35:35.177220 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.149996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:45937 (local address 127.0.0.1:41000)
0806 20:35:35.168513 (+ 18517us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.168531 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:35.168676 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:35.169665 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:35.169669 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:35.169692 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:35.170148 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.170160 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.171614 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.171621 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.174749 (+ 3128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.174762 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.176367 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.176374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.176572 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.176610 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 20:35:35.176710 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 20:35:35.176851 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18378,"mutex_wait_us":134,"thread_start_us":10914,"threads_started":1}
I20260806 20:35:35.177299 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.150724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41000 (local address 127.13.149.67:45937)
0806 20:35:35.165734 (+ 15010us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.165743 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.168853 (+ 3110us) server_negotiation.cc:407] Connection header received
0806 20:35:35.168970 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.168978 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.169180 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.169360 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:35.170373 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.171479 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.174934 (+ 3455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.176157 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.176312 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.176534 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.176763 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.176945 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14821,"thread_start_us":14649,"threads_started":1}
I20260806 20:35:35.177472 7335 tablet_service.cc:1467] Processing CreateTablet for tablet 84b259f7886e4c5cbf569dbecc907954 (DEFAULT_TABLE table=test-table [id=9e71ae636b1747c09c84b59654c087dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:35:35.178399 7550 tablet_service.cc:1467] Processing CreateTablet for tablet 84b259f7886e4c5cbf569dbecc907954 (DEFAULT_TABLE table=test-table [id=9e71ae636b1747c09c84b59654c087dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:35:35.178964 7335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84b259f7886e4c5cbf569dbecc907954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:35:35.179750 7550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84b259f7886e4c5cbf569dbecc907954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:35:35.180449 7760 tablet_service.cc:1467] Processing CreateTablet for tablet 84b259f7886e4c5cbf569dbecc907954 (DEFAULT_TABLE table=test-table [id=9e71ae636b1747c09c84b59654c087dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:35:35.181596 7760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84b259f7886e4c5cbf569dbecc907954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:35:35.189198 7889 tablet_bootstrap.cc:492] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Bootstrap starting.
I20260806 20:35:35.193519 7889 tablet_bootstrap.cc:654] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Neither blocks nor log segments found. Creating new log.
I20260806 20:35:35.194617 7890 tablet_bootstrap.cc:492] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Bootstrap starting.
I20260806 20:35:35.194849 7889 log.cc:824] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:35.198845 7890 tablet_bootstrap.cc:654] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Neither blocks nor log segments found. Creating new log.
I20260806 20:35:35.200187 7890 log.cc:824] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:35.200331 7889 tablet_bootstrap.cc:492] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: No bootstrap required, opened a new log
I20260806 20:35:35.200642 7889 ts_tablet_manager.cc:1397] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260806 20:35:35.201797 7892 tablet_bootstrap.cc:492] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Bootstrap starting.
I20260806 20:35:35.203536 7890 tablet_bootstrap.cc:492] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: No bootstrap required, opened a new log
I20260806 20:35:35.203800 7890 ts_tablet_manager.cc:1397] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260806 20:35:35.205129 7892 tablet_bootstrap.cc:654] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Neither blocks nor log segments found. Creating new log.
I20260806 20:35:35.206081 7892 log.cc:824] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:35.209204 7892 tablet_bootstrap.cc:492] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: No bootstrap required, opened a new log
I20260806 20:35:35.209468 7892 ts_tablet_manager.cc:1397] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 20:35:35.211623 7889 raft_consensus.cc:348] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.212131 7889 raft_consensus.cc:374] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:35:35.212236 7889 raft_consensus.cc:729] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab694a45f2144ddb96d67142789c8f3, State: Initialized, Role: FOLLOWER
I20260806 20:35:35.212945 7889 consensus_queue.cc:260] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.215037 7889 ts_tablet_manager.cc:1428] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Time spent starting tablet: real 0.014s user 0.009s sys 0.003s
I20260806 20:35:35.214812 7890 raft_consensus.cc:348] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.215329 7890 raft_consensus.cc:374] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:35:35.215466 7890 raft_consensus.cc:729] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 785a3965d1394c5698ae78088f2b249e, State: Initialized, Role: FOLLOWER
I20260806 20:35:35.216087 7890 consensus_queue.cc:260] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.217237 7865 heartbeater.cc:503] Master 127.13.149.126:41689 was elected leader, sending a full tablet report...
I20260806 20:35:35.218547 7892 raft_consensus.cc:348] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.218935 7892 raft_consensus.cc:374] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:35:35.219064 7892 raft_consensus.cc:729] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3529383ee65491e84a8cf189c01a06a, State: Initialized, Role: FOLLOWER
I20260806 20:35:35.219182 7890 ts_tablet_manager.cc:1428] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
I20260806 20:35:35.219597 7892 consensus_queue.cc:260] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.220800 7654 heartbeater.cc:503] Master 127.13.149.126:41689 was elected leader, sending a full tablet report...
I20260806 20:35:35.221351 7892 ts_tablet_manager.cc:1428] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
W20260806 20:35:35.326278 7866 tablet.cc:2369] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:35:35.330649 7896 raft_consensus.cc:482] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:35:35.331018 7896 raft_consensus.cc:504] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.333083 7896 leader_election.cc:288] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879), 9ab694a45f2144ddb96d67142789c8f3 (127.13.149.65:35249)
I20260806 20:35:35.340381 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.333681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:45761 (local address 127.13.149.65:35249)
0806 20:35:35.333937 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.333945 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.334103 (+ 158us) server_negotiation.cc:407] Connection header received
0806 20:35:35.334364 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.334372 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.334466 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.334588 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:35.335102 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.336183 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.338332 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.339416 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.339549 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.339603 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.339989 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.340098 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:35:35.340400 7867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.333559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.13.149.67:45761)
0806 20:35:35.333973 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.333998 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:35.334186 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:35.334645 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:35.334652 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:35.334682 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:35.334945 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.334957 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.336338 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.336344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.338131 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.338144 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.339574 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.339580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.339782 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.339821 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 20:35:35.339927 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 20:35:35.340065 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"spinlock_wait_cycles":25856}
I20260806 20:35:35.341223 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.333673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:37063 (local address 127.13.149.66:33879)
0806 20:35:35.333909 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.333916 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.334675 (+ 759us) server_negotiation.cc:407] Connection header received
0806 20:35:35.334964 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.334970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.335055 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.335141 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:35:35.335874 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.336901 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.339110 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.340166 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.340321 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.340391 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.340863 (+ 472us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.340971 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 20:35:35.341272 7901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.333684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:33879 (local address 127.13.149.67:37063)
0806 20:35:35.334552 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.334572 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:35:35.334776 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:35:35.335196 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:35:35.335203 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:35:35.335234 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:35:35.335660 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.335673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.337070 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.337074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.338854 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:35:35.338869 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.340432 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.340442 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:35:35.340634 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.340677 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 20:35:35.340813 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 20:35:35.340944 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":1,"spinlock_wait_cycles":22912,"thread_start_us":482,"threads_started":1}
I20260806 20:35:35.341651 7372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b259f7886e4c5cbf569dbecc907954" candidate_uuid: "785a3965d1394c5698ae78088f2b249e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab694a45f2144ddb96d67142789c8f3" is_pre_election: true
I20260806 20:35:35.342257 7372 raft_consensus.cc:2454] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 785a3965d1394c5698ae78088f2b249e in term 0.
I20260806 20:35:35.342398 7578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b259f7886e4c5cbf569dbecc907954" candidate_uuid: "785a3965d1394c5698ae78088f2b249e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3529383ee65491e84a8cf189c01a06a" is_pre_election: true
I20260806 20:35:35.342896 7578 raft_consensus.cc:2454] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 785a3965d1394c5698ae78088f2b249e in term 0.
I20260806 20:35:35.343001 7684 leader_election.cc:302] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 785a3965d1394c5698ae78088f2b249e, 9ab694a45f2144ddb96d67142789c8f3; no voters:
I20260806 20:35:35.343463 7896 raft_consensus.cc:2781] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:35:35.343652 7896 raft_consensus.cc:482] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:35:35.343773 7896 raft_consensus.cc:3037] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:35:35.346336 7896 raft_consensus.cc:504] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
I20260806 20:35:35.347065 7896 leader_election.cc:288] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [CANDIDATE]: Term 1 election: Requested vote from peers b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879), 9ab694a45f2144ddb96d67142789c8f3 (127.13.149.65:35249)
I20260806 20:35:35.347333 7578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b259f7886e4c5cbf569dbecc907954" candidate_uuid: "785a3965d1394c5698ae78088f2b249e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3529383ee65491e84a8cf189c01a06a"
I20260806 20:35:35.347543 7578 raft_consensus.cc:3037] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:35:35.347584 7372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b259f7886e4c5cbf569dbecc907954" candidate_uuid: "785a3965d1394c5698ae78088f2b249e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab694a45f2144ddb96d67142789c8f3"
I20260806 20:35:35.347755 7372 raft_consensus.cc:3037] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:35:35.350036 7372 raft_consensus.cc:2454] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 785a3965d1394c5698ae78088f2b249e in term 1.
I20260806 20:35:35.350095 7578 raft_consensus.cc:2454] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 785a3965d1394c5698ae78088f2b249e in term 1.
I20260806 20:35:35.350517 7684 leader_election.cc:302] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 785a3965d1394c5698ae78088f2b249e, 9ab694a45f2144ddb96d67142789c8f3; no voters:
I20260806 20:35:35.350860 7896 raft_consensus.cc:2781] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:35:35.351414 7896 raft_consensus.cc:686] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 1 LEADER]: Becoming Leader. State: Replica: 785a3965d1394c5698ae78088f2b249e, State: Running, Role: LEADER
I20260806 20:35:35.351878 7896 consensus_queue.cc:237] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } }
W20260806 20:35:35.353574 7655 tablet.cc:2369] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:35:35.356801 7153 catalog_manager.cc:5495] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e reported cstate change: term changed from 0 to 1, leader changed from <none> to 785a3965d1394c5698ae78088f2b249e (127.13.149.67). New cstate: current_term: 1 leader_uuid: "785a3965d1394c5698ae78088f2b249e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "785a3965d1394c5698ae78088f2b249e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45937 } health_report { overall_health: HEALTHY } } }
W20260806 20:35:35.377724 7446 tablet.cc:2369] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:35:35.415920 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.410671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41006 (local address 127.13.149.67:45937)
0806 20:35:35.410876 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.410881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.410900 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:35:35.411006 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.411010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.411087 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.411207 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:35:35.411578 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.412328 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.413900 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.414289 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.414384 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.414841 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:35:35.415324 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:35:35.415439 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.415554 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.415617 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:35:35.424346 7578 raft_consensus.cc:1261] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Refusing update from remote peer 785a3965d1394c5698ae78088f2b249e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:35:35.424347 7372 raft_consensus.cc:1261] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 FOLLOWER]: Refusing update from remote peer 785a3965d1394c5698ae78088f2b249e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:35:35.425354 7896 consensus_queue.cc:1035] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3529383ee65491e84a8cf189c01a06a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 33879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:35:35.425644 7905 consensus_queue.cc:1035] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab694a45f2144ddb96d67142789c8f3" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:35:35.438431 7912 mvcc.cc:205] Tried to move back new op lower bound from 7315654801086562304 to 7315654800805400576. Current Snapshot: MvccSnapshot[applied={T|T < 7315654801086562304}]
I20260806 20:35:35.449412 7154 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:35:35.449669 7154 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:35:35.453316 7154 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Sending DeleteTablet for 3 replicas of tablet 84b259f7886e4c5cbf569dbecc907954
I20260806 20:35:35.454526 7550 tablet_service.cc:1514] Processing DeleteTablet for tablet 84b259f7886e4c5cbf569dbecc907954 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:35:35 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:47936
I20260806 20:35:35.454735 7760 tablet_service.cc:1514] Processing DeleteTablet for tablet 84b259f7886e4c5cbf569dbecc907954 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:35:35 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:41000
I20260806 20:35:35.455279 7335 tablet_service.cc:1514] Processing DeleteTablet for tablet 84b259f7886e4c5cbf569dbecc907954 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:35:35 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:54808
I20260806 20:35:35.455443 7928 tablet_replica.cc:330] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: stopping tablet replica
I20260806 20:35:35.455844 7928 raft_consensus.cc:2229] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:35:35.456492 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 7206
I20260806 20:35:35.456485 7928 raft_consensus.cc:2258] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:35:35.459250 7928 ts_tablet_manager.cc:1905] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:35.466776 7928 ts_tablet_manager.cc:1918] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:35:35.467028 7928 log.cc:1196] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/84b259f7886e4c5cbf569dbecc907954
I20260806 20:35:35.467720 7928 ts_tablet_manager.cc:1939] T 84b259f7886e4c5cbf569dbecc907954 P b3529383ee65491e84a8cf189c01a06a: Deleting consensus metadata
I20260806 20:35:35.469954 7132 catalog_manager.cc:4841] TS b3529383ee65491e84a8cf189c01a06a (127.13.149.66:33879): tablet 84b259f7886e4c5cbf569dbecc907954 (table test-table [id=9e71ae636b1747c09c84b59654c087dd]) successfully deleted
I20260806 20:35:35.477293 7932 tablet_replica.cc:330] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: stopping tablet replica
I20260806 20:35:35.477902 7932 raft_consensus.cc:2229] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:35:35.478543 7932 raft_consensus.cc:2258] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:35:35.479497 7929 tablet_replica.cc:330] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: stopping tablet replica
I20260806 20:35:35.479964 7929 raft_consensus.cc:2229] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:35:35.480710 7932 ts_tablet_manager.cc:1905] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:35.480736 7929 raft_consensus.cc:2258] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:35:35.482590 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.457705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54816 (local address 127.13.149.65:35249)
0806 20:35:35.457885 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.457891 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.457908 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:35:35.457963 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.457968 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.458054 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.458154 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:35.460190 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.461332 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.463315 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.463969 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.464092 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.471868 (+ 7776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:35.471892 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:35.471916 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:35.471974 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:35.477173 (+ 5199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.478079 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.478088 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.478091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.478296 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.478782 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.478786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.478789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.479978 (+ 1189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:35.480306 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.481929 (+ 1623us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.482170 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:35:35.482926 7929 ts_tablet_manager.cc:1905] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:35.483493 7436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:35.493328 7929 ts_tablet_manager.cc:1918] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:35:35.493513 7929 log.cc:1196] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/84b259f7886e4c5cbf569dbecc907954
I20260806 20:35:35.494027 7929 ts_tablet_manager.cc:1939] T 84b259f7886e4c5cbf569dbecc907954 P 785a3965d1394c5698ae78088f2b249e: Deleting consensus metadata
I20260806 20:35:35.495533 7130 catalog_manager.cc:4841] TS 785a3965d1394c5698ae78088f2b249e (127.13.149.67:45937): tablet 84b259f7886e4c5cbf569dbecc907954 (table test-table [id=9e71ae636b1747c09c84b59654c087dd]) successfully deleted
I20260806 20:35:35.642506 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 7206
W20260806 20:35:35.667016 7131 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.149.65:35249 (error 108)
I20260806 20:35:35.667357 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 7453
I20260806 20:35:35.669263 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.668724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54824)
0806 20:35:35.668959 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.669082 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260806 20:35:35.669546 7131 catalog_manager.cc:4584] TS 9ab694a45f2144ddb96d67142789c8f3 (127.13.149.65:35249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 84b259f7886e4c5cbf569dbecc907954: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
I20260806 20:35:35.682091 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.668221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47948 (local address 127.13.149.66:33879)
0806 20:35:35.668414 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.668418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.668521 (+ 103us) server_negotiation.cc:407] Connection header received
0806 20:35:35.668731 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.668736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.668846 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.668965 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:35.670580 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.671403 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.672870 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.673240 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.673382 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.676233 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:35.676245 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:35.676260 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:35.676297 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:35.679197 (+ 2900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.679925 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.679932 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.679934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.680057 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.680453 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.680459 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.680462 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.680905 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:35.681202 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.681534 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.681756 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:35:35.682817 7644 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:35.723258 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.722715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54826)
0806 20:35:35.722947 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.723077 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 20:35:35.724553 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.724101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54836)
0806 20:35:35.724279 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.724398 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 20:35:35.775419 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 7453
I20260806 20:35:35.785347 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.784732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54844)
0806 20:35:35.785020 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.785135 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260806 20:35:35.786645 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.786205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54854)
0806 20:35:35.786386 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.786482 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 20:35:35.803607 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 7657
I20260806 20:35:35.819988 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.804509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41016 (local address 127.13.149.67:45937)
0806 20:35:35.804694 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:35:35.804706 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:35:35.804732 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:35:35.805036 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:35:35.805041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:35:35.805114 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:35:35.805237 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:35:35.806577 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.807392 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.808764 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:35:35.809383 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:35:35.809532 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:35:35.812403 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:35:35.812419 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:35:35.812440 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:35:35.812498 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:35:35.816654 (+ 4156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.817525 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.817536 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.817540 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.817741 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:35:35.818137 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:35:35.818144 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:35:35.818153 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:35:35.818665 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:35:35.819010 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 20:35:35.819274 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 20:35:35.819516 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:35:35.820772 7859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:35.867542 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.866919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54862)
0806 20:35:35.867247 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.867341 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
I20260806 20:35:35.868731 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:35.868308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54870)
0806 20:35:35.868529 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:35.868616 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260806 20:35:35.946376 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 7657
I20260806 20:35:35.974466 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 7095
I20260806 20:35:35.975709 7196 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:35:36.090761 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:36.090169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35249 (local address 127.0.0.1:54876)
0806 20:35:36.090386 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:36.090549 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 20:35:36.090937 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 7095
I20260806 20:35:56.116768 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41689
--webserver_interface=127.13.149.126
--webserver_port=33185
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:41689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:35:56.485208 7944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:56.485510 7944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:56.485669 7944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:56.493602 7944 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 20:35:56.493712 7944 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 20:35:56.493752 7944 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 20:35:56.493855 7944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:35:56.493929 7944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:56.494047 7944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:56.494125 7944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:35:56.494201 7944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:35:56.504552 7944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:41689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:41689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=33185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:56.505930 7944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:56.507295 7944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:56.519788 7954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:56.519697 7960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:56.519755 7957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:56.520063 7944 server_base.cc:1034] running on GCE node
I20260806 20:35:56.521185 7944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:56.522545 7944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:56.523854 7944 hybrid_clock.cc:648] HybridClock initialized: now 1786048556523774 us; error 33 us; skew 500 ppm
I20260806 20:35:56.524257 7944 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:56 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048556, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:56.527758 7944 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:35:56.529495 7944 webserver.cc:460] Webserver started at http://127.13.149.126:33185/ using document root <none> and password file <none>
I20260806 20:35:56.530299 7944 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:56.530450 7944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:56.536132 7944 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 20:35:56.539074 7967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:56.540453 7944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:35:56.540649 7944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "ba5e281137c440ca8efdf694efd8dbd4"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "5b85665afeba9ba9c371967a3698aaf9"
server_key_iv: "8b2fed4fe16739d345eb665518b057b3"
server_key_version: "encryptionkey@0"
I20260806 20:35:56.541750 7944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:56.565137 7944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:56.569032 7944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:56.569307 7944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:56.588486 7944 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:41689
I20260806 20:35:56.588508 8050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:41689 every 8 connection(s)
I20260806 20:35:56.589973 7944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:35:56.591742 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 7944
I20260806 20:35:56.592885 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:35249
--local_ip_for_outbound_sockets=127.13.149.65
--tserver_master_addrs=127.13.149.126:41689
--webserver_port=34093
--webserver_interface=127.13.149.65
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:35:56.599709 8052 sys_catalog.cc:263] Verifying existing consensus state
I20260806 20:35:56.604981 8052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Bootstrap starting.
I20260806 20:35:56.626451 8052 log.cc:824] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Log is configured to *not* fsync() on all Append() calls
I20260806 20:35:56.642824 8052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 20:35:56.643385 8052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Bootstrap complete.
I20260806 20:35:56.653344 8052 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:56.654269 8052 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5e281137c440ca8efdf694efd8dbd4, State: Initialized, Role: FOLLOWER
I20260806 20:35:56.654942 8052 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:56.655194 8052 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:35:56.655318 8052 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:35:56.655534 8052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 2 FOLLOWER]: Advancing to term 3
I20260806 20:35:56.659679 8052 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:56.660192 8052 leader_election.cc:302] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba5e281137c440ca8efdf694efd8dbd4; no voters:
I20260806 20:35:56.660953 8052 leader_election.cc:288] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 20:35:56.661106 8059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 20:35:56.662278 8059 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [term 3 LEADER]: Becoming Leader. State: Replica: ba5e281137c440ca8efdf694efd8dbd4, State: Running, Role: LEADER
I20260806 20:35:56.662942 8059 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } }
I20260806 20:35:56.663362 8052 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:35:56.665472 8061 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba5e281137c440ca8efdf694efd8dbd4. Latest consensus state: current_term: 3 leader_uuid: "ba5e281137c440ca8efdf694efd8dbd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } } }
I20260806 20:35:56.665850 8061 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:35:56.666415 8060 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ba5e281137c440ca8efdf694efd8dbd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba5e281137c440ca8efdf694efd8dbd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 41689 } } }
I20260806 20:35:56.666715 8060 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:35:56.676870 8067 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:35:56.686311 8067 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:35:56.687891 8067 catalog_manager.cc:1259] Loaded cluster ID: 5cfa127c97a745999fa4e5776273ff79
I20260806 20:35:56.688076 8067 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:35:56.692689 8067 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:35:56.694607 8067 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Loaded TSK: 0
I20260806 20:35:56.694835 8067 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba5e281137c440ca8efdf694efd8dbd4: Loaded TSK: 1
F20260806 20:35:56.695990 8067 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f28837569ad google::LogMessage::Fail() at ??:0
@ 0x7f288375988a google::LogMessage::SendToLog() at ??:0
@ 0x7f28837564de google::LogMessage::Flush() at ??:0
@ 0x7f2883757a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f28874ba7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f28874a973e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f28991891c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2899188783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f28992142a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f28992140c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f289925e5e9 std::function<>::operator()() at ??:0
@ 0x7f289918ccdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f289918ac36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2899212610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f2899212439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f28863a2345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f28863a591c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f28863a5799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2886380eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f288965a6db start_thread at ??:0
@ 0x7f28825f061f clone at ??:0
W20260806 20:35:56.990597 8055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:56.990932 8055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:56.991109 8055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:56.998620 8055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:56.998771 8055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:56.998945 8055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:35:57.008857 8055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:35249
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=34093
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:57.010111 8055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:57.011432 8055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:57.024586 8125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:57.024669 8133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:57.024628 8127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:57.026175 8055 server_base.cc:1034] running on GCE node
I20260806 20:35:57.026784 8055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:57.027699 8055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:57.028880 8055 hybrid_clock.cc:648] HybridClock initialized: now 1786048557028842 us; error 41 us; skew 500 ppm
I20260806 20:35:57.029193 8055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:57 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048557, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:57.032398 8055 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:35:57.034013 8055 webserver.cc:460] Webserver started at http://127.13.149.65:34093/ using document root <none> and password file <none>
I20260806 20:35:57.034765 8055 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:57.034934 8055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:57.040256 8055 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:35:57.043357 8145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:57.045073 8055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:35:57.045256 8055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "9ab694a45f2144ddb96d67142789c8f3"
format_stamp: "Formatted at 2026-08-06 20:35:10 on dist-test-slave-2kcd"
server_key: "95db77650465daf12ea109988cade800"
server_key_iv: "b1a161cd4c2b915effc5b20bed831199"
server_key_version: "encryptionkey@0"
I20260806 20:35:57.046361 8055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:57.066359 8055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:57.070399 8055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:57.070680 8055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:57.071745 8055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:57.073648 8156 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260806 20:35:57.079077 8156 ts_tablet_manager.cc:1852] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260806 20:35:57.080111 8156 ts_tablet_manager.cc:1905] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:35:57.087241 8156 ts_tablet_manager.cc:1918] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:35:57.087468 8156 log.cc:1196] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/84b259f7886e4c5cbf569dbecc907954
I20260806 20:35:57.088028 8156 ts_tablet_manager.cc:1939] T 84b259f7886e4c5cbf569dbecc907954 P 9ab694a45f2144ddb96d67142789c8f3: Deleting consensus metadata
I20260806 20:35:57.088435 8055 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260806 20:35:57.088595 8055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.000s sys 0.001s
I20260806 20:35:57.088740 8055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:57.088862 8055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:57.124516 8055 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:35249
I20260806 20:35:57.124549 8320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:35249 every 8 connection(s)
I20260806 20:35:57.125892 8055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:35:57.130975 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:57.129065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:37103)
0806 20:35:57.129826 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:57.130097 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":297,"threads_started":1}
W20260806 20:35:57.131619 8321 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:41689 (0 consecutive failures): Network error: Failed to ping master at 127.13.149.126:41689: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
I20260806 20:35:57.132543 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:57.132171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:45721)
0806 20:35:57.132349 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:57.132427 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 20:35:57.133496 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:57.133162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:38921)
0806 20:35:57.133287 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:57.133373 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 20:35:57.133765 8321 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 20:35:57.136266 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 8055
I20260806 20:35:57.136965 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:33879
--local_ip_for_outbound_sockets=127.13.149.66
--tserver_master_addrs=127.13.149.126:41689
--webserver_port=41017
--webserver_interface=127.13.149.66
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:35:57.477732 8325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:57.478014 8325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:57.478194 8325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:57.485507 8325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:57.485636 8325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:57.485808 8325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:35:57.495402 8325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:33879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=41017
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:57.496690 8325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:57.498054 8325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:57.511498 8334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:57.511404 8336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:57.511466 8340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:57.512585 8325 server_base.cc:1034] running on GCE node
I20260806 20:35:57.513341 8325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:57.514292 8325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:57.515534 8325 hybrid_clock.cc:648] HybridClock initialized: now 1786048557515490 us; error 31 us; skew 500 ppm
I20260806 20:35:57.515961 8325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:57 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048557, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:57.519125 8325 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:35:57.520481 8325 webserver.cc:460] Webserver started at http://127.13.149.66:41017/ using document root <none> and password file <none>
I20260806 20:35:57.521195 8325 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:57.521298 8325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:57.526772 8325 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260806 20:35:57.529464 8351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:57.530781 8325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:35:57.530933 8325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "b3529383ee65491e84a8cf189c01a06a"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "1d4424c73a8c4978522652648cb647e8"
server_key_iv: "481b7345fb63d9e3c101ada0550e5bf5"
server_key_version: "encryptionkey@0"
I20260806 20:35:57.531869 8325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:57.547559 8325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:57.551892 8325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:57.552152 8325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:57.553135 8325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:57.554471 8325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:35:57.554575 8325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:57.554656 8325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:57.554715 8325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:57.590139 8325 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:33879
I20260806 20:35:57.590238 8521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:33879 every 8 connection(s)
I20260806 20:35:57.591610 8325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:35:57.596472 8530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:57.594652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:53045)
0806 20:35:57.595373 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:57.595638 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":304,"threads_started":1}
W20260806 20:35:57.597214 8523 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:41689 (0 consecutive failures): Network error: Failed to ping master at 127.13.149.126:41689: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
I20260806 20:35:57.597700 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 8325
I20260806 20:35:57.598143 8530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:57.597770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:60077)
0806 20:35:57.597965 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:57.598035 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 20:35:57.598479 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:45937
--local_ip_for_outbound_sockets=127.13.149.67
--tserver_master_addrs=127.13.149.126:41689
--webserver_port=38641
--webserver_interface=127.13.149.67
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:35:57.599292 8530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:57.598790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:46361)
0806 20:35:57.599027 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:57.599125 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260806 20:35:57.599566 8523 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 20:35:57.939184 8531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:35:57.939451 8531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:35:57.939630 8531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:35:57.946717 8531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:35:57.946817 8531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:35:57.947033 8531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:35:57.956657 8531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:45937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=38641
--tserver_master_addrs=127.13.149.126:41689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:35:57.957962 8531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:35:57.959267 8531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:35:57.972527 8543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:57.972613 8538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:35:57.972574 8540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:35:57.973721 8531 server_base.cc:1034] running on GCE node
I20260806 20:35:57.974339 8531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:35:57.975244 8531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:35:57.976444 8531 hybrid_clock.cc:648] HybridClock initialized: now 1786048557976394 us; error 39 us; skew 500 ppm
I20260806 20:35:57.976755 8531 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:35:57 dist-test-slave-2kcd krb5kdc[6218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048557, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:35:57.980067 8531 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:35:57.981557 8531 webserver.cc:460] Webserver started at http://127.13.149.67:38641/ using document root <none> and password file <none>
I20260806 20:35:57.982203 8531 fs_manager.cc:359] Metadata directory not provided
I20260806 20:35:57.982339 8531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:35:57.987457 8531 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 20:35:57.990105 8551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:57.991374 8531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:35:57.991545 8531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "785a3965d1394c5698ae78088f2b249e"
format_stamp: "Formatted at 2026-08-06 20:35:11 on dist-test-slave-2kcd"
server_key: "6022254e5a6c5902f4a47eec4b372cb2"
server_key_iv: "50fac73a0504f8316fa16aa80b55edcd"
server_key_version: "encryptionkey@0"
I20260806 20:35:57.992534 8531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:35:58.016584 8531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:35:58.021099 8531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:35:58.021378 8531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:35:58.022341 8531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:35:58.023855 8531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:35:58.023976 8531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:58.024116 8531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:35:58.024225 8531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:35:58.060442 8531 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:45937
I20260806 20:35:58.060534 8724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:45937 every 8 connection(s)
I20260806 20:35:58.062077 8531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:35:58.066989 8728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:58.065113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:53555)
0806 20:35:58.065868 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:58.066121 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":304,"threads_started":1}
W20260806 20:35:58.067610 8726 heartbeater.cc:644] Failed to heartbeat to 127.13.149.126:41689 (0 consecutive failures): Network error: Failed to ping master at 127.13.149.126:41689: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
I20260806 20:35:58.068467 8728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:58.068104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:41633)
0806 20:35:58.068270 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:58.068342 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 20:35:58.069331 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 8531
I20260806 20:35:58.069473 8728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:58.069026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:54723)
0806 20:35:58.069202 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:58.069298 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:35:58.069787 8726 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 20:35:58.135166 8732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:58.134326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:51845)
0806 20:35:58.134781 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:58.134935 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":220,"threads_started":1}
I20260806 20:35:58.601141 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:58.600176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:57851)
0806 20:35:58.600661 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:58.600768 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":251,"threads_started":1}
I20260806 20:35:59.071115 8735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:59.070285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:45731)
0806 20:35:59.070781 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:59.070875 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":251,"threads_started":1}
I20260806 20:35:59.136797 8737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:59.136069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:37249)
0806 20:35:59.136498 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:59.136609 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":229,"threads_started":1}
I20260806 20:35:59.602929 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:35:59.602116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:53105)
0806 20:35:59.602654 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0806 20:35:59.602738 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":293,"threads_started":1}
I20260806 20:36:00.072691 8739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:00.071984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:58301)
0806 20:36:00.072447 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:00.072526 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":225,"threads_started":1}
I20260806 20:36:00.138444 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:00.137704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:49667)
0806 20:36:00.138188 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:00.138273 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":251,"threads_started":1}
I20260806 20:36:00.604564 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:00.603798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:35957)
0806 20:36:00.604309 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:00.604388 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":293,"threads_started":1}
I20260806 20:36:01.074527 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:01.073728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:48383)
0806 20:36:01.074251 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:01.074333 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":316,"threads_started":1}
I20260806 20:36:01.140048 8744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:01.139318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:42399)
0806 20:36:01.139769 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:01.139878 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":231,"threads_started":1}
I20260806 20:36:01.606143 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:01.605435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:33463)
0806 20:36:01.605849 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:01.605926 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":209,"threads_started":1}
I20260806 20:36:02.076310 8750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:02.075569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:55185)
0806 20:36:02.076024 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:02.076108 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":229,"threads_started":1}
I20260806 20:36:02.141748 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:02.141017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:54365)
0806 20:36:02.141501 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:02.141582 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":245,"threads_started":1}
I20260806 20:36:02.607748 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:02.607035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:36889)
0806 20:36:02.607500 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:02.607581 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":236,"threads_started":1}
I20260806 20:36:03.077863 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:03.077170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:54705)
0806 20:36:03.077633 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:03.077709 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":255,"threads_started":1}
I20260806 20:36:03.143432 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:03.142649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:55207)
0806 20:36:03.143105 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:03.143206 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":244,"threads_started":1}
I20260806 20:36:03.609615 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:03.608749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:56985)
0806 20:36:03.609337 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:03.609444 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":285,"threads_started":1}
I20260806 20:36:04.079501 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:04.078775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:60409)
0806 20:36:04.079221 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:04.079320 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":236,"threads_started":1}
I20260806 20:36:04.145185 8762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:04.144325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:36809)
0806 20:36:04.144886 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:04.144970 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":248,"threads_started":1}
I20260806 20:36:04.611423 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:04.610615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:57561)
0806 20:36:04.611120 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:04.611201 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":232,"threads_started":1}
I20260806 20:36:05.081292 8765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:05.080426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:52695)
0806 20:36:05.080988 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:05.081071 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":230,"threads_started":1}
I20260806 20:36:05.146795 8766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:05.146151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:47109)
0806 20:36:05.146560 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:05.146638 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":221,"threads_started":1}
I20260806 20:36:05.612990 8767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:05.612283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:41483)
0806 20:36:05.612701 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:05.612775 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":221,"threads_started":1}
I20260806 20:36:06.082808 8769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:06.082146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:44251)
0806 20:36:06.082576 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:06.082653 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":224,"threads_started":1}
I20260806 20:36:06.148433 8771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:06.147684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:46929)
0806 20:36:06.148162 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:06.148254 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":251,"threads_started":1}
I20260806 20:36:06.614733 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:06.613915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:53739)
0806 20:36:06.614466 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:06.614549 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":267,"threads_started":1}
I20260806 20:36:07.084635 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:07.083838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:41635)
0806 20:36:07.084355 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:07.084443 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":267,"threads_started":1}
I20260806 20:36:07.150221 8776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:07.149477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:39827)
0806 20:36:07.149953 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:07.150048 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":239,"threads_started":1}
I20260806 20:36:07.616477 8778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:07.615673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:38687)
0806 20:36:07.616228 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:07.616309 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":343,"threads_started":1}
I20260806 20:36:08.086246 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:08.085553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:43119)
0806 20:36:08.086000 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:08.086081 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":239,"threads_started":1}
I20260806 20:36:08.151950 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:08.151111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:54885)
0806 20:36:08.151606 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:08.151695 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":292,"threads_started":1}
I20260806 20:36:08.618115 8781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:08.617393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:54591)
0806 20:36:08.617827 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:08.617917 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":219,"threads_started":1}
I20260806 20:36:09.087922 8782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:09.087200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:57923)
0806 20:36:09.087641 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:09.087736 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":222,"threads_started":1}
I20260806 20:36:09.153995 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:09.153197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:55101)
0806 20:36:09.153749 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:09.153829 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":334,"threads_started":1}
I20260806 20:36:09.619823 8786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:09.619081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:41035)
0806 20:36:09.619579 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:09.619663 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":252,"threads_started":1}
I20260806 20:36:10.089763 8788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:10.089042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:59003)
0806 20:36:10.089506 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:10.089590 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":230,"threads_started":1}
I20260806 20:36:10.155787 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:10.154961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:33819)
0806 20:36:10.155484 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:10.155591 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":265,"threads_started":1}
I20260806 20:36:10.621750 8791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:10.620937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:59967)
0806 20:36:10.621448 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:10.621552 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":238,"threads_started":1}
I20260806 20:36:11.091524 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:11.090699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:32881)
0806 20:36:11.091216 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:11.091315 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":269,"threads_started":1}
I20260806 20:36:11.157563 8796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:11.156774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:41745)
0806 20:36:11.157278 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:11.157367 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":219,"threads_started":1}
I20260806 20:36:11.623474 8799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:11.622734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:42319)
0806 20:36:11.623192 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:11.623273 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":238,"threads_started":1}
I20260806 20:36:12.093400 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:12.092619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:53081)
0806 20:36:12.093119 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:12.093200 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":289,"threads_started":1}
I20260806 20:36:12.159510 8802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:12.158742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.65:55299)
0806 20:36:12.159208 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:12.159315 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":231,"threads_started":1}
I20260806 20:36:12.625458 8803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:12.624678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.66:54419)
0806 20:36:12.625177 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:12.625267 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":297,"threads_started":1}
I20260806 20:36:13.078241 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 8055
I20260806 20:36:13.095676 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:13.094797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:41689 (local address 127.13.149.67:41705)
0806 20:36:13.095273 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:13.095464 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.126:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":247,"threads_started":1}
I20260806 20:36:13.105824 8806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:13.079463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40236 (local address 127.13.149.65:35249)
0806 20:36:13.080108 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:13.080123 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:13.080160 (+ 37us) server_negotiation.cc:407] Connection header received
0806 20:36:13.082416 (+ 2256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:13.082426 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:13.082855 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:13.083154 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:13.084667 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:13.086090 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:13.087386 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:13.088101 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:13.088237 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:13.099096 (+ 10859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:13.099107 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:13.099126 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:13.099173 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:13.102469 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:13.103254 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:13.103262 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:13.103269 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:13.103453 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:13.103787 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:13.103790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:13.103792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:13.104355 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:13.104609 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:13.105055 (+ 446us) server_negotiation.cc:299] Negotiation successful
0806 20:36:13.105530 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":733,"threads_started":1}
I20260806 20:36:13.107273 8314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:13.193061 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 8055
I20260806 20:36:13.217320 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 8325
I20260806 20:36:13.235894 8814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:13.218255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51060 (local address 127.13.149.66:33879)
0806 20:36:13.218783 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:13.218799 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:13.218838 (+ 39us) server_negotiation.cc:407] Connection header received
0806 20:36:13.220459 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:13.220469 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:13.220995 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:13.221356 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:13.222978 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:13.224223 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:13.225793 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:13.226475 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:13.226692 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:13.229459 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:13.229467 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:13.229482 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:13.229520 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:13.232433 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:13.233221 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:13.233229 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:13.233235 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:13.233405 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:13.233812 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:13.233816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:13.233819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:13.234327 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:13.234659 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:13.235176 (+ 517us) server_negotiation.cc:299] Negotiation successful
0806 20:36:13.235592 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":249,"threads_started":1}
I20260806 20:36:13.237414 8516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:13.321971 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 8325
I20260806 20:36:13.349385 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 8531
I20260806 20:36:13.367353 8816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:13.350413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45888 (local address 127.13.149.67:45937)
0806 20:36:13.351071 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:13.351086 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:13.351131 (+ 45us) server_negotiation.cc:407] Connection header received
0806 20:36:13.352834 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:13.352853 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:13.353320 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:13.353616 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:13.355040 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:13.356370 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:13.357741 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:13.358442 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:13.358587 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:13.361330 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:13.361337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:13.361353 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:13.361391 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:13.364404 (+ 3013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:13.365136 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:13.365143 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:13.365149 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:13.365316 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:13.365636 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:13.365639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:13.365641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:13.366172 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:13.366424 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:13.366721 (+ 297us) server_negotiation.cc:299] Negotiation successful
0806 20:36:13.367058 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":301,"threads_started":1}
I20260806 20:36:13.368865 8717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:13.454129 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 8531
2026-08-06T20:36:13Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65170 ms)
[----------] 30 tests from SecurityITest (307496 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:13 dist-test-slave-2kcd krb5kdc[8821](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:13 dist-test-slave-2kcd krb5kdc[8821](info): set up 2 sockets
Aug 06 20:36:13 dist-test-slave-2kcd krb5kdc[8821](info): commencing operation
krb5kdc: starting...
W20260806 20:36:14.816877 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:15 dist-test-slave-2kcd krb5kdc[8821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:36:15.132397 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:39483
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:39483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:15.472759 8837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:15.473137 8837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:15.473234 8837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:15.480441 8837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:15.480549 8837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:15.480604 8837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:15.480665 8837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:15.480710 8837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:15.491016 8837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:39483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:39483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:15.492374 8837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:15.493736 8837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:15.506065 8850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:15.506130 8847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:15.506033 8845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:15.507700 8837 server_base.cc:1034] running on GCE node
I20260806 20:36:15.508574 8837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:15.510058 8837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:15.511299 8837 hybrid_clock.cc:648] HybridClock initialized: now 1786048575511257 us; error 48 us; skew 500 ppm
I20260806 20:36:15.511658 8837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:15 dist-test-slave-2kcd krb5kdc[8821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048575, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:15.514916 8837 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:36:15.516522 8837 webserver.cc:460] Webserver started at http://127.13.149.126:37589/ using document root <none> and password file <none>
I20260806 20:36:15.517307 8837 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:15.517464 8837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:15.517776 8837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:15.520771 8837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "4d7593af0ca14239b359169adc97ec07"
format_stamp: "Formatted at 2026-08-06 20:36:15 on dist-test-slave-2kcd"
server_key: "140aab8bb72d4fbd2a34c07e9a3eee8e"
server_key_iv: "5211daf9dc9069100a6d196b0954e7c9"
server_key_version: "encryptionkey@0"
I20260806 20:36:15.521616 8837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "4d7593af0ca14239b359169adc97ec07"
format_stamp: "Formatted at 2026-08-06 20:36:15 on dist-test-slave-2kcd"
server_key: "140aab8bb72d4fbd2a34c07e9a3eee8e"
server_key_iv: "5211daf9dc9069100a6d196b0954e7c9"
server_key_version: "encryptionkey@0"
I20260806 20:36:15.526763 8837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:36:15.530208 8864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:15.531524 8837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:36:15.531716 8837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "4d7593af0ca14239b359169adc97ec07"
format_stamp: "Formatted at 2026-08-06 20:36:15 on dist-test-slave-2kcd"
server_key: "140aab8bb72d4fbd2a34c07e9a3eee8e"
server_key_iv: "5211daf9dc9069100a6d196b0954e7c9"
server_key_version: "encryptionkey@0"
I20260806 20:36:15.531920 8837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:15.561074 8837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:15.565269 8837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:15.565580 8837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:15.585630 8837 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:39483
I20260806 20:36:15.585670 8953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:39483 every 8 connection(s)
I20260806 20:36:15.587036 8837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:15.587733 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 8837
I20260806 20:36:15.587994 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:15.588840 13909 external_mini_cluster.cc:1428] Setting key 3e2081a19d076597001eea54b014c4a4
I20260806 20:36:15.591666 8955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 20:36:15 dist-test-slave-2kcd krb5kdc[8821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:15.604625 8955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07: Bootstrap starting.
I20260806 20:36:15.608310 8955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:15.609505 8955 log.cc:824] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:15.612320 8955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07: No bootstrap required, opened a new log
I20260806 20:36:15.613618 8960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:15.591013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36882 (local address 127.13.149.126:39483)
0806 20:36:15.591834 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:15.591857 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:15.591911 (+ 54us) server_negotiation.cc:407] Connection header received
0806 20:36:15.594421 (+ 2510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:15.594448 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:15.594982 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:15.595430 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:15.596913 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:15.599001 (+ 2088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:15.600379 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:15.601443 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:15.601632 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:15.605730 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:15.605741 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:15.605759 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:15.605803 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:15.609368 (+ 3565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:15.610159 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:15.610166 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:15.610177 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:15.610351 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:15.610765 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:15.610770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:15.610773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:15.611300 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:15.611612 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:15.612104 (+ 492us) server_negotiation.cc:299] Negotiation successful
0806 20:36:15.612596 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":330,"threads_started":1}
I20260806 20:36:15.620462 8955 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7593af0ca14239b359169adc97ec07" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39483 } }
I20260806 20:36:15.620834 8955 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:15.620957 8955 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7593af0ca14239b359169adc97ec07, State: Initialized, Role: FOLLOWER
I20260806 20:36:15.621560 8955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7593af0ca14239b359169adc97ec07" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39483 } }
I20260806 20:36:15.621796 8955 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:15.621932 8955 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:15.622107 8955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:15.624467 8955 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7593af0ca14239b359169adc97ec07" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39483 } }
I20260806 20:36:15.625020 8955 leader_election.cc:302] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d7593af0ca14239b359169adc97ec07; no voters:
I20260806 20:36:15.625582 8955 leader_election.cc:288] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:15.625723 8962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:15.626521 8962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [term 1 LEADER]: Becoming Leader. State: Replica: 4d7593af0ca14239b359169adc97ec07, State: Running, Role: LEADER
I20260806 20:36:15.627064 8962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7593af0ca14239b359169adc97ec07" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39483 } }
I20260806 20:36:15.627676 8955 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:15.629930 8966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d7593af0ca14239b359169adc97ec07. Latest consensus state: current_term: 1 leader_uuid: "4d7593af0ca14239b359169adc97ec07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7593af0ca14239b359169adc97ec07" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39483 } } }
I20260806 20:36:15.630334 8964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d7593af0ca14239b359169adc97ec07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7593af0ca14239b359169adc97ec07" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39483 } } }
I20260806 20:36:15.630753 8966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:15.630774 8964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:15.631995 8977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:15.637924 8977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:15.647322 8977 catalog_manager.cc:1347] Generated new cluster ID: 122cee1a9ef045f98fe6aff98000818d
I20260806 20:36:15.647445 8977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:15.674901 8977 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:15.676306 8977 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:15.686790 8977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07: Generated new TSK 0
I20260806 20:36:15.687919 8977 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:36:15.759605 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39483
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:16.107662 8997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:16.107969 8997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:16.108067 8997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:16.115343 8997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:16.115450 8997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:16.115561 8997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:36:16.125375 8997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:16.126602 8997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:16.128026 8997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:16.141706 9003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:16.141739 9005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:16.141810 9002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:16.146349 8997 server_base.cc:1034] running on GCE node
I20260806 20:36:16.147087 8997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:16.148237 8997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:16.149484 8997 hybrid_clock.cc:648] HybridClock initialized: now 1786048576149433 us; error 54 us; skew 500 ppm
I20260806 20:36:16.149852 8997 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:16 dist-test-slave-2kcd krb5kdc[8821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048576, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:16.153160 8997 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:36:16.154759 8997 webserver.cc:460] Webserver started at http://127.13.149.65:36491/ using document root <none> and password file <none>
I20260806 20:36:16.155511 8997 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:16.155664 8997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:16.156000 8997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:16.159200 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "9900c6b646e744a8b3d565af97fcd15b"
format_stamp: "Formatted at 2026-08-06 20:36:16 on dist-test-slave-2kcd"
server_key: "7a8308e1fd32bab31bef6e842a863428"
server_key_iv: "4df0a5727301cc4e4dc2e2be40d29d41"
server_key_version: "encryptionkey@0"
I20260806 20:36:16.160030 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "9900c6b646e744a8b3d565af97fcd15b"
format_stamp: "Formatted at 2026-08-06 20:36:16 on dist-test-slave-2kcd"
server_key: "7a8308e1fd32bab31bef6e842a863428"
server_key_iv: "4df0a5727301cc4e4dc2e2be40d29d41"
server_key_version: "encryptionkey@0"
I20260806 20:36:16.165442 8997 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 20:36:16.169219 9016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:16.170534 8997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:36:16.170729 8997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "9900c6b646e744a8b3d565af97fcd15b"
format_stamp: "Formatted at 2026-08-06 20:36:16 on dist-test-slave-2kcd"
server_key: "7a8308e1fd32bab31bef6e842a863428"
server_key_iv: "4df0a5727301cc4e4dc2e2be40d29d41"
server_key_version: "encryptionkey@0"
I20260806 20:36:16.170951 8997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:16.217777 8997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:16.221974 8997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:16.222293 8997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:16.223353 8997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:16.224704 8997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:16.224826 8997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:16.225008 8997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:16.225088 8997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:16.262356 8997 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:45767
I20260806 20:36:16.262415 9197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:45767 every 8 connection(s)
I20260806 20:36:16.263710 8997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:36:16.269918 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 8997
I20260806 20:36:16.270184 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:36:16.270869 13909 external_mini_cluster.cc:1428] Setting key 50a922cbd718909931c544ae00ac1e02
Aug 06 20:36:16 dist-test-slave-2kcd krb5kdc[8821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048576, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:16.286155 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:16.266307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:34805 (local address 127.13.149.126:39483)
0806 20:36:16.266770 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:16.266776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:16.267769 (+ 993us) server_negotiation.cc:407] Connection header received
0806 20:36:16.269765 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:16.269771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:16.269866 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:16.269996 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:16.271736 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.272574 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.274258 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.275054 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.275232 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:16.279030 (+ 3798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:16.279039 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:16.279046 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:16.279092 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:16.282787 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:16.283506 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:16.283513 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:16.283519 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:16.283682 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:16.284100 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:16.284108 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:16.284114 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:16.284490 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:16.284665 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:16.285412 (+ 747us) server_negotiation.cc:299] Negotiation successful
0806 20:36:16.285682 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":212,"threads_started":1}
I20260806 20:36:16.286782 9203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:16.266907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39483 (local address 127.13.149.65:34805)
0806 20:36:16.267611 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:16.267650 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:16.269486 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:16.270277 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:16.270289 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:16.270845 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:16.271518 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:16.271545 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.272745 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.272751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:16.274056 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:16.274120 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.275350 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.275356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:16.275571 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:16.276343 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:16.276376 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:16.278798 (+ 2422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:16.282937 (+ 4139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:16.282943 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:16.282956 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:16.283354 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:16.283790 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:16.283793 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:16.283795 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:16.283981 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:16.284627 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:16.284632 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:16.285011 (+ 379us) client_negotiation.cc:769] Sending connection context
0806 20:36:16.285235 (+ 224us) client_negotiation.cc:240] Negotiation successful
0806 20:36:16.285627 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":279,"threads_started":1}
I20260806 20:36:16.288435 9198 heartbeater.cc:347] Connected to a master server at 127.13.149.126:39483
I20260806 20:36:16.288750 9198 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:16.289512 9198 heartbeater.cc:511] Master 127.13.149.126:39483 requested a full tablet report, sending...
I20260806 20:36:16.291700 8896 ts_manager.cc:194] Registered new tserver with Master: 9900c6b646e744a8b3d565af97fcd15b (127.13.149.65:45767)
I20260806 20:36:16.293213 8896 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:34805
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:36:16.340142 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39483
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:16.679723 9207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:16.679992 9207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:16.680154 9207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:16.687578 9207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:16.687676 9207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:16.687889 9207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:36:16.697667 9207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:16.698921 9207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:16.700209 9207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:16.713285 9215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:16.713330 9217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:16.713389 9219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:16.714504 9207 server_base.cc:1034] running on GCE node
I20260806 20:36:16.715138 9207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:16.716019 9207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:16.717214 9207 hybrid_clock.cc:648] HybridClock initialized: now 1786048576717159 us; error 48 us; skew 500 ppm
I20260806 20:36:16.717470 9207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:16 dist-test-slave-2kcd krb5kdc[8821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048576, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:16.720441 9207 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:36:16.721786 9207 webserver.cc:460] Webserver started at http://127.13.149.66:36081/ using document root <none> and password file <none>
I20260806 20:36:16.722460 9207 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:16.722563 9207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:16.722812 9207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:16.725664 9207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "65c29d9392db4d8688e36de8782aafb7"
format_stamp: "Formatted at 2026-08-06 20:36:16 on dist-test-slave-2kcd"
server_key: "54c1fa11a6856a9884f5de0e3df0249a"
server_key_iv: "66f857b5c527369617e403c6758970eb"
server_key_version: "encryptionkey@0"
I20260806 20:36:16.726378 9207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "65c29d9392db4d8688e36de8782aafb7"
format_stamp: "Formatted at 2026-08-06 20:36:16 on dist-test-slave-2kcd"
server_key: "54c1fa11a6856a9884f5de0e3df0249a"
server_key_iv: "66f857b5c527369617e403c6758970eb"
server_key_version: "encryptionkey@0"
I20260806 20:36:16.731657 9207 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 20:36:16.735265 9227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:16.736613 9207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:36:16.736845 9207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "65c29d9392db4d8688e36de8782aafb7"
format_stamp: "Formatted at 2026-08-06 20:36:16 on dist-test-slave-2kcd"
server_key: "54c1fa11a6856a9884f5de0e3df0249a"
server_key_iv: "66f857b5c527369617e403c6758970eb"
server_key_version: "encryptionkey@0"
I20260806 20:36:16.737103 9207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:16.774005 9207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:16.778380 9207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:16.778630 9207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:16.779596 9207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:16.780936 9207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:16.781019 9207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:16.781104 9207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:16.781149 9207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:16.822099 9207 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:35607
I20260806 20:36:16.822160 9424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:35607 every 8 connection(s)
I20260806 20:36:16.823408 9207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:36:16.829253 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 9207
I20260806 20:36:16.829455 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:36:16.829897 13909 external_mini_cluster.cc:1428] Setting key 7eebd03b8caf40b2aedff42417da0eb0
Aug 06 20:36:16 dist-test-slave-2kcd krb5kdc[8821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048576, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:16.845553 9428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:16.826021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:57417 (local address 127.13.149.126:39483)
0806 20:36:16.826503 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:16.826508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:16.827317 (+ 809us) server_negotiation.cc:407] Connection header received
0806 20:36:16.829337 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:16.829344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:16.829438 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:16.829560 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:16.831180 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.832240 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.833942 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.834727 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.834882 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:16.838465 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:16.838473 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:16.838481 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:16.838523 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:16.842213 (+ 3690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:16.842916 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:16.842924 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:16.842930 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:16.843089 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:16.843497 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:16.843511 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:16.843517 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:16.843914 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:16.844066 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:16.844725 (+ 659us) server_negotiation.cc:299] Negotiation successful
0806 20:36:16.845038 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":259,"threads_started":1}
I20260806 20:36:16.846148 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:16.826427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39483 (local address 127.13.149.66:57417)
0806 20:36:16.827145 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:16.827190 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:16.829071 (+ 1881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:16.829794 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:16.829802 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:16.830380 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:16.831002 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:16.831026 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.832391 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.832395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:16.833793 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:16.833805 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:16.835006 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:16.835011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:16.835203 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:16.835949 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:16.835989 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:16.838230 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:16.842357 (+ 4127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:16.842363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:16.842376 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:16.842781 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:16.843197 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:16.843200 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:16.843202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:16.843381 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:16.844048 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:16.844053 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:16.844360 (+ 307us) client_negotiation.cc:769] Sending connection context
0806 20:36:16.844582 (+ 222us) client_negotiation.cc:240] Negotiation successful
0806 20:36:16.845021 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":295,"threads_started":1}
I20260806 20:36:16.847630 9425 heartbeater.cc:347] Connected to a master server at 127.13.149.126:39483
I20260806 20:36:16.847971 9425 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:16.848685 9425 heartbeater.cc:511] Master 127.13.149.126:39483 requested a full tablet report, sending...
I20260806 20:36:16.850176 8896 ts_manager.cc:194] Registered new tserver with Master: 65c29d9392db4d8688e36de8782aafb7 (127.13.149.66:35607)
I20260806 20:36:16.850982 8896 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:57417
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:36:16.899895 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39483
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:17.243117 9432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:17.243423 9432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:17.243585 9432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:17.250943 9432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:17.251104 9432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:17.251291 9432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:36:17.261065 9432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:39483
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:17.262778 9432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:17.264494 9432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:17.278968 9443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:17.279105 9445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:17.279224 9432 server_base.cc:1034] running on GCE node
W20260806 20:36:17.278935 9442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:17.280057 9432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:17.281113 9432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:17.282310 9432 hybrid_clock.cc:648] HybridClock initialized: now 1786048577282251 us; error 57 us; skew 500 ppm
I20260806 20:36:17.282618 9432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:17 dist-test-slave-2kcd krb5kdc[8821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048577, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:17.285756 9432 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:36:17.287211 9432 webserver.cc:460] Webserver started at http://127.13.149.67:43219/ using document root <none> and password file <none>
I20260806 20:36:17.287864 9432 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:17.287966 9432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:17.288231 9432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:17.291194 9432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "9b3b54e4204447109c97eb596debdca9"
format_stamp: "Formatted at 2026-08-06 20:36:17 on dist-test-slave-2kcd"
server_key: "3bf416f5aeeecfd0dad665247fd49b24"
server_key_iv: "43614f1c53337c3e8dacf414cb41b601"
server_key_version: "encryptionkey@0"
I20260806 20:36:17.291942 9432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "9b3b54e4204447109c97eb596debdca9"
format_stamp: "Formatted at 2026-08-06 20:36:17 on dist-test-slave-2kcd"
server_key: "3bf416f5aeeecfd0dad665247fd49b24"
server_key_iv: "43614f1c53337c3e8dacf414cb41b601"
server_key_version: "encryptionkey@0"
I20260806 20:36:17.296095 9198 heartbeater.cc:503] Master 127.13.149.126:39483 was elected leader, sending a full tablet report...
I20260806 20:36:17.297374 9432 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260806 20:36:17.301134 9458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:17.302433 9432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:36:17.302611 9432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "9b3b54e4204447109c97eb596debdca9"
format_stamp: "Formatted at 2026-08-06 20:36:17 on dist-test-slave-2kcd"
server_key: "3bf416f5aeeecfd0dad665247fd49b24"
server_key_iv: "43614f1c53337c3e8dacf414cb41b601"
server_key_version: "encryptionkey@0"
I20260806 20:36:17.302806 9432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:17.319739 9432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:17.323786 9432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:17.324087 9432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:17.325119 9432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:17.326488 9432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:17.326603 9432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:17.326766 9432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:17.326850 9432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:17.361559 9432 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:43903
I20260806 20:36:17.361600 9648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:43903 every 8 connection(s)
I20260806 20:36:17.362854 9432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:36:17.370471 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 9432
I20260806 20:36:17.370668 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:36:17.371122 13909 external_mini_cluster.cc:1428] Setting key 11de3cdf84c4e5faf0fc4f0e55feb10e
Aug 06 20:36:17 dist-test-slave-2kcd krb5kdc[8821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048577, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:17.382616 9652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.365511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:33209 (local address 127.13.149.126:39483)
0806 20:36:17.365998 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.366002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.366785 (+ 783us) server_negotiation.cc:407] Connection header received
0806 20:36:17.368622 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.368627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.368719 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.368877 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:17.370346 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.371258 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.373100 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.373699 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.373830 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.377445 (+ 3615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:17.377449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:17.377453 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:17.377483 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:17.379980 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:17.380623 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:17.380627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:17.380629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:17.380740 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:17.381180 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:17.381183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:17.381185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:17.381451 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:17.381576 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.382188 (+ 612us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.382352 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":261,"threads_started":1}
I20260806 20:36:17.383581 9653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.365929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39483 (local address 127.13.149.67:33209)
0806 20:36:17.366627 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:17.366665 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:17.368339 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:17.369112 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:17.369120 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:17.369622 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:17.370173 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.370189 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.371419 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.371423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.372946 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.372958 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.373923 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.373929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.374213 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.374910 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:17.374937 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:17.377239 (+ 2302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:17.380102 (+ 2863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:17.380108 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:17.380120 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:17.380513 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:17.380899 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:17.380902 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:17.380904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:17.381079 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:17.381570 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:17.381575 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:17.381865 (+ 290us) client_negotiation.cc:769] Sending connection context
0806 20:36:17.382089 (+ 224us) client_negotiation.cc:240] Negotiation successful
0806 20:36:17.382450 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":275,"threads_started":1}
I20260806 20:36:17.385102 9649 heartbeater.cc:347] Connected to a master server at 127.13.149.126:39483
I20260806 20:36:17.385452 9649 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:17.386349 9649 heartbeater.cc:511] Master 127.13.149.126:39483 requested a full tablet report, sending...
I20260806 20:36:17.387797 8896 ts_manager.cc:194] Registered new tserver with Master: 9b3b54e4204447109c97eb596debdca9 (127.13.149.67:43903)
I20260806 20:36:17.388581 8896 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:33209
I20260806 20:36:17.398878 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:36:17.415786 9652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.403386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36892 (local address 127.13.149.126:39483)
0806 20:36:17.403608 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.403618 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.403980 (+ 362us) server_negotiation.cc:407] Connection header received
0806 20:36:17.404128 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.404131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.404191 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.404269 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:17.405796 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.406572 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.407992 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.408360 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.408452 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.410973 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:17.410983 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:17.410986 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:17.411015 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:17.413486 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:17.414061 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:17.414064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:17.414066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:17.414178 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:17.414489 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:17.414492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:17.414493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:17.414781 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:17.414963 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.415219 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.415425 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 20:36:17.419909 8896 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:36:17.426805 8896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:36:17.461488 9674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.440983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52308 (local address 127.13.149.66:35607)
0806 20:36:17.453150 (+ 12167us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.453162 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.453193 (+ 31us) server_negotiation.cc:407] Connection header received
0806 20:36:17.453310 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.453320 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.453600 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.454700 (+ 1100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:17.454879 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.455872 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.458818 (+ 2946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.460209 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.460367 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.460599 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.460950 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.461124 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11987,"thread_start_us":12753,"threads_started":1}
I20260806 20:36:17.461601 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.440741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:35607 (local address 127.0.0.1:52308)
0806 20:36:17.451647 (+ 10906us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:17.451670 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:17.451813 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:17.454069 (+ 2256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:17.454076 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:17.454108 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:17.454531 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.454543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.456008 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.456015 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.458640 (+ 2625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.458655 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.460441 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.460448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.460691 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.460732 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 20:36:17.460893 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 20:36:17.461122 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10743,"mutex_wait_us":1,"thread_start_us":9326,"threads_started":1}
I20260806 20:36:17.464670 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.440333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:45767 (local address 127.0.0.1:57682)
0806 20:36:17.449533 (+ 9200us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:17.449597 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:17.449827 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:17.457158 (+ 7331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:17.457163 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:17.457189 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:17.457608 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.457620 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.459607 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.459614 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.461972 (+ 2358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.461990 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.463808 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.463814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.463988 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.464034 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 20:36:17.464158 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 20:36:17.464310 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8855,"thread_start_us":10989,"threads_started":1}
I20260806 20:36:17.465137 9676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.452229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57260 (local address 127.13.149.67:43903)
0806 20:36:17.454355 (+ 2126us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.454365 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.457214 (+ 2849us) server_negotiation.cc:407] Connection header received
0806 20:36:17.457316 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.457323 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.457489 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.457684 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:17.458292 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.459776 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.462296 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.464031 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.464182 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.464406 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.464599 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.464754 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":574,"threads_started":1}
I20260806 20:36:17.465710 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.440465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57682 (local address 127.13.149.65:45767)
0806 20:36:17.456537 (+ 16072us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.456545 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.456574 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:36:17.456672 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.456683 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.456935 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.457818 (+ 883us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:17.458043 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.459476 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.462156 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.463594 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.463744 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.463971 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.465116 (+ 1145us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.465423 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15894,"thread_start_us":15711,"threads_started":1}
I20260806 20:36:17.466130 9677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.453197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43903 (local address 127.0.0.1:57260)
0806 20:36:17.456916 (+ 3719us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:17.456934 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:17.457082 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:17.457673 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:17.457677 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:17.457703 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:17.458119 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.458129 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.459922 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.459927 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.462161 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.462171 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.464250 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.464256 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.464411 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.464452 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 20:36:17.464554 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 20:36:17.464681 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3597,"thread_start_us":3384,"threads_started":1}
I20260806 20:36:17.466400 9312 tablet_service.cc:1467] Processing CreateTablet for tablet 6ffeb9257f314f4783a19b82b5b41c44 (DEFAULT_TABLE table=test-table [id=89c90e93212a4e04bb7f351a072c8c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:17.467893 9312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ffeb9257f314f4783a19b82b5b41c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:17.469214 9099 tablet_service.cc:1467] Processing CreateTablet for tablet 6ffeb9257f314f4783a19b82b5b41c44 (DEFAULT_TABLE table=test-table [id=89c90e93212a4e04bb7f351a072c8c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:17.469770 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 6ffeb9257f314f4783a19b82b5b41c44 (DEFAULT_TABLE table=test-table [id=89c90e93212a4e04bb7f351a072c8c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:17.470459 9099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ffeb9257f314f4783a19b82b5b41c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:17.471118 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ffeb9257f314f4783a19b82b5b41c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:17.482692 9678 tablet_bootstrap.cc:492] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Bootstrap starting.
I20260806 20:36:17.485558 9679 tablet_bootstrap.cc:492] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Bootstrap starting.
I20260806 20:36:17.486389 9678 tablet_bootstrap.cc:654] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:17.487754 9678 log.cc:824] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:17.489327 9679 tablet_bootstrap.cc:654] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:17.489331 9680 tablet_bootstrap.cc:492] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Bootstrap starting.
I20260806 20:36:17.490571 9679 log.cc:824] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:17.491400 9678 tablet_bootstrap.cc:492] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: No bootstrap required, opened a new log
I20260806 20:36:17.491688 9678 ts_tablet_manager.cc:1397] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 20:36:17.493500 9680 tablet_bootstrap.cc:654] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:17.494977 9680 log.cc:824] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:17.497960 9679 tablet_bootstrap.cc:492] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: No bootstrap required, opened a new log
I20260806 20:36:17.498265 9679 ts_tablet_manager.cc:1397] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260806 20:36:17.498517 9680 tablet_bootstrap.cc:492] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: No bootstrap required, opened a new log
I20260806 20:36:17.498795 9680 ts_tablet_manager.cc:1397] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260806 20:36:17.499570 9678 raft_consensus.cc:348] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.499981 9678 raft_consensus.cc:374] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:17.500110 9678 raft_consensus.cc:729] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9900c6b646e744a8b3d565af97fcd15b, State: Initialized, Role: FOLLOWER
I20260806 20:36:17.500743 9678 consensus_queue.cc:260] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.505904 9678 ts_tablet_manager.cc:1428] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Time spent starting tablet: real 0.014s user 0.005s sys 0.009s
I20260806 20:36:17.509210 9679 raft_consensus.cc:348] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.509295 9680 raft_consensus.cc:348] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.509682 9679 raft_consensus.cc:374] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:17.509776 9680 raft_consensus.cc:374] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:17.509791 9679 raft_consensus.cc:729] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c29d9392db4d8688e36de8782aafb7, State: Initialized, Role: FOLLOWER
I20260806 20:36:17.509888 9680 raft_consensus.cc:729] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3b54e4204447109c97eb596debdca9, State: Initialized, Role: FOLLOWER
I20260806 20:36:17.510452 9679 consensus_queue.cc:260] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.510525 9680 consensus_queue.cc:260] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.512650 9425 heartbeater.cc:503] Master 127.13.149.126:39483 was elected leader, sending a full tablet report...
I20260806 20:36:17.513192 9649 heartbeater.cc:503] Master 127.13.149.126:39483 was elected leader, sending a full tablet report...
I20260806 20:36:17.513343 9679 ts_tablet_manager.cc:1428] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260806 20:36:17.513764 9680 ts_tablet_manager.cc:1428] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
W20260806 20:36:17.516185 9199 tablet.cc:2369] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:17.575481 9427 tablet.cc:2369] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:17.614513 9650 tablet.cc:2369] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:17.775856 9685 raft_consensus.cc:482] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:36:17.776204 9685 raft_consensus.cc:504] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.778096 9685 leader_election.cc:288] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b3b54e4204447109c97eb596debdca9 (127.13.149.67:43903), 65c29d9392db4d8688e36de8782aafb7 (127.13.149.66:35607)
I20260806 20:36:17.785821 9674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.778914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:39379 (local address 127.13.149.66:35607)
0806 20:36:17.779124 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.779132 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.779541 (+ 409us) server_negotiation.cc:407] Connection header received
0806 20:36:17.779748 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.779755 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.779843 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.779924 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:17.780590 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.781419 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.783901 (+ 2482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.784740 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.784989 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.785084 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.785403 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.785543 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 20:36:17.785852 9676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.778561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:43957 (local address 127.13.149.67:43903)
0806 20:36:17.778821 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.778831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.779689 (+ 858us) server_negotiation.cc:407] Connection header received
0806 20:36:17.779890 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.779894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.779994 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.780092 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:17.780752 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.781593 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.784024 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.784845 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.785039 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.785131 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.785472 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.785603 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:36:17.785974 9690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.778399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:35607 (local address 127.13.149.65:39379)
0806 20:36:17.779410 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:17.779427 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:17.779594 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:17.779966 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:17.779970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:17.779995 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:17.780426 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.780435 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.781553 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.781560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.783734 (+ 2174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.783746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.785047 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.785053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.785235 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.785258 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 20:36:17.785335 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 20:36:17.785485 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"mutex_wait_us":67,"thread_start_us":764,"threads_started":1}
I20260806 20:36:17.785998 9689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.778397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43903 (local address 127.13.149.65:43957)
0806 20:36:17.779565 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:17.779585 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:17.779745 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:17.780126 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:17.780129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:17.780161 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:17.780587 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.780598 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.781746 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.781753 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.783776 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:17.783789 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.785083 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.785089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:17.785278 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.785301 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 20:36:17.785419 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 20:36:17.785542 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":119,"thread_start_us":542,"threads_started":1}
I20260806 20:36:17.787166 9578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffeb9257f314f4783a19b82b5b41c44" candidate_uuid: "9900c6b646e744a8b3d565af97fcd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3b54e4204447109c97eb596debdca9" is_pre_election: true
I20260806 20:36:17.787169 9345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffeb9257f314f4783a19b82b5b41c44" candidate_uuid: "9900c6b646e744a8b3d565af97fcd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c29d9392db4d8688e36de8782aafb7" is_pre_election: true
I20260806 20:36:17.787767 9345 raft_consensus.cc:2454] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9900c6b646e744a8b3d565af97fcd15b in term 0.
I20260806 20:36:17.787767 9578 raft_consensus.cc:2454] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9900c6b646e744a8b3d565af97fcd15b in term 0.
I20260806 20:36:17.788522 9022 leader_election.cc:302] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9900c6b646e744a8b3d565af97fcd15b, 9b3b54e4204447109c97eb596debdca9; no voters:
I20260806 20:36:17.789021 9685 raft_consensus.cc:2781] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:36:17.789181 9685 raft_consensus.cc:482] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:36:17.789289 9685 raft_consensus.cc:3037] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:17.791497 9685 raft_consensus.cc:504] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.792111 9685 leader_election.cc:288] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [CANDIDATE]: Term 1 election: Requested vote from peers 9b3b54e4204447109c97eb596debdca9 (127.13.149.67:43903), 65c29d9392db4d8688e36de8782aafb7 (127.13.149.66:35607)
I20260806 20:36:17.792647 9345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffeb9257f314f4783a19b82b5b41c44" candidate_uuid: "9900c6b646e744a8b3d565af97fcd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c29d9392db4d8688e36de8782aafb7"
I20260806 20:36:17.792647 9578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ffeb9257f314f4783a19b82b5b41c44" candidate_uuid: "9900c6b646e744a8b3d565af97fcd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b3b54e4204447109c97eb596debdca9"
I20260806 20:36:17.792882 9578 raft_consensus.cc:3037] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:17.792882 9345 raft_consensus.cc:3037] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:17.796165 9345 raft_consensus.cc:2454] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9900c6b646e744a8b3d565af97fcd15b in term 1.
I20260806 20:36:17.796151 9578 raft_consensus.cc:2454] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9900c6b646e744a8b3d565af97fcd15b in term 1.
I20260806 20:36:17.796540 9022 leader_election.cc:302] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9900c6b646e744a8b3d565af97fcd15b, 9b3b54e4204447109c97eb596debdca9; no voters:
I20260806 20:36:17.796840 9685 raft_consensus.cc:2781] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:17.797281 9685 raft_consensus.cc:686] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 1 LEADER]: Becoming Leader. State: Replica: 9900c6b646e744a8b3d565af97fcd15b, State: Running, Role: LEADER
I20260806 20:36:17.797760 9685 consensus_queue.cc:237] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } }
I20260806 20:36:17.802729 8894 catalog_manager.cc:5495] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9900c6b646e744a8b3d565af97fcd15b (127.13.149.65). New cstate: current_term: 1 leader_uuid: "9900c6b646e744a8b3d565af97fcd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9900c6b646e744a8b3d565af97fcd15b" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 45767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 } health_report { overall_health: UNKNOWN } } }
I20260806 20:36:17.830286 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.823788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.13.149.65:45767)
0806 20:36:17.824003 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.824011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.824138 (+ 127us) server_negotiation.cc:407] Connection header received
0806 20:36:17.824330 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.824357 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.824462 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.824617 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:36:17.825142 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.825942 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.827930 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.828473 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.828615 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.829213 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:36:17.829700 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:36:17.829825 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.829949 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.830025 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:36:17.839316 9345 raft_consensus.cc:1261] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 1 FOLLOWER]: Refusing update from remote peer 9900c6b646e744a8b3d565af97fcd15b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:17.839397 9578 raft_consensus.cc:1261] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 1 FOLLOWER]: Refusing update from remote peer 9900c6b646e744a8b3d565af97fcd15b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:17.840339 9691 consensus_queue.cc:1035] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b3b54e4204447109c97eb596debdca9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:17.840687 9685 consensus_queue.cc:1035] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c29d9392db4d8688e36de8782aafb7" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 35607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:17.863881 8895 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:17.864194 8895 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:17.868284 8895 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d7593af0ca14239b359169adc97ec07: Sending DeleteTablet for 3 replicas of tablet 6ffeb9257f314f4783a19b82b5b41c44
I20260806 20:36:17.869536 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffeb9257f314f4783a19b82b5b41c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:17 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:57260
I20260806 20:36:17.869787 9099 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffeb9257f314f4783a19b82b5b41c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:17 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:57682
I20260806 20:36:17.870277 9312 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ffeb9257f314f4783a19b82b5b41c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:17 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:52308
I20260806 20:36:17.870744 9710 tablet_replica.cc:330] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: stopping tablet replica
I20260806 20:36:17.871165 9710 raft_consensus.cc:2229] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:36:17.871857 9710 raft_consensus.cc:2258] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:17.872188 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 8997
I20260806 20:36:17.874255 9710 ts_tablet_manager.cc:1905] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:17.884994 9710 ts_tablet_manager.cc:1918] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:17.885185 9710 log.cc:1196] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/6ffeb9257f314f4783a19b82b5b41c44
I20260806 20:36:17.885789 9710 ts_tablet_manager.cc:1939] T 6ffeb9257f314f4783a19b82b5b41c44 P 9900c6b646e744a8b3d565af97fcd15b: Deleting consensus metadata
I20260806 20:36:17.887745 8876 catalog_manager.cc:4841] TS 9900c6b646e744a8b3d565af97fcd15b (127.13.149.65:45767): tablet 6ffeb9257f314f4783a19b82b5b41c44 (table test-table [id=89c90e93212a4e04bb7f351a072c8c48]) successfully deleted
I20260806 20:36:17.888268 9711 tablet_replica.cc:330] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: stopping tablet replica
Aug 06 20:36:17 dist-test-slave-2kcd krb5kdc[8821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:36:17.888746 9711 raft_consensus.cc:2229] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:17.889281 9711 raft_consensus.cc:2258] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:17.890044 9709 tablet_replica.cc:330] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: stopping tablet replica
I20260806 20:36:17.890432 9709 raft_consensus.cc:2229] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:17.890895 9709 raft_consensus.cc:2258] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:17.893098 9711 ts_tablet_manager.cc:1905] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:17.894536 9709 ts_tablet_manager.cc:1905] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:17.897686 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:17.874162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57702 (local address 127.13.149.65:45767)
0806 20:36:17.874334 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:17.874340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:17.877474 (+ 3134us) server_negotiation.cc:407] Connection header received
0806 20:36:17.877778 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:17.877784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:17.877903 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:17.877985 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:17.879814 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.881229 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.883162 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:17.883888 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:17.883982 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:17.890077 (+ 6095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:17.890087 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:17.890099 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:17.890166 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:17.893960 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:17.894844 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:17.894865 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:17.894868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:17.895047 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:17.895543 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:17.895548 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:17.895552 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:17.895968 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:17.896263 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:17.897062 (+ 799us) server_negotiation.cc:299] Negotiation successful
0806 20:36:17.897306 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 20:36:17.899070 9192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:17.900220 9711 ts_tablet_manager.cc:1918] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:17.900389 9711 log.cc:1196] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/6ffeb9257f314f4783a19b82b5b41c44
I20260806 20:36:17.901283 9711 ts_tablet_manager.cc:1939] T 6ffeb9257f314f4783a19b82b5b41c44 P 65c29d9392db4d8688e36de8782aafb7: Deleting consensus metadata
I20260806 20:36:17.903465 8874 catalog_manager.cc:4841] TS 65c29d9392db4d8688e36de8782aafb7 (127.13.149.66:35607): tablet 6ffeb9257f314f4783a19b82b5b41c44 (table test-table [id=89c90e93212a4e04bb7f351a072c8c48]) successfully deleted
I20260806 20:36:17.903903 9709 ts_tablet_manager.cc:1918] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:17.904062 9709 log.cc:1196] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/6ffeb9257f314f4783a19b82b5b41c44
I20260806 20:36:17.904528 9709 ts_tablet_manager.cc:1939] T 6ffeb9257f314f4783a19b82b5b41c44 P 9b3b54e4204447109c97eb596debdca9: Deleting consensus metadata
I20260806 20:36:17.905972 8876 catalog_manager.cc:4841] TS 9b3b54e4204447109c97eb596debdca9 (127.13.149.67:43903): tablet 6ffeb9257f314f4783a19b82b5b41c44 (table test-table [id=89c90e93212a4e04bb7f351a072c8c48]) successfully deleted
I20260806 20:36:17.995945 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 8997
I20260806 20:36:18.024889 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 9207
Aug 06 20:36:18 dist-test-slave-2kcd krb5kdc[8821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:36:18.040858 9674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:18.025723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52312 (local address 127.13.149.66:35607)
0806 20:36:18.025929 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:18.025936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:18.026065 (+ 129us) server_negotiation.cc:407] Connection header received
0806 20:36:18.026286 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:18.026291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:18.026365 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:18.026479 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:18.027878 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:18.028621 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:18.029983 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:18.030362 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:18.030502 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:18.035055 (+ 4553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:18.035070 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:18.035086 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:18.035120 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:18.038029 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:18.038696 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:18.038704 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:18.038706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:18.038829 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:18.039223 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:18.039228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:18.039231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:18.039610 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:18.039905 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:18.040221 (+ 316us) server_negotiation.cc:299] Negotiation successful
0806 20:36:18.040466 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:36:18.041594 9419 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:18.132723 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 9207
I20260806 20:36:18.159622 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 9432
Aug 06 20:36:18 dist-test-slave-2kcd krb5kdc[8821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:36:18.179445 9676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:18.160470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57268 (local address 127.13.149.67:43903)
0806 20:36:18.160676 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:18.160683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:18.160703 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:36:18.161007 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:18.161018 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:18.161089 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:18.161204 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:18.162574 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:18.163307 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:18.164579 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:18.165137 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:18.165274 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:18.173474 (+ 8200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:18.173492 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:18.173509 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:18.173544 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:18.176347 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:18.177259 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:18.177269 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:18.177272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:18.177422 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:18.177829 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:18.177840 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:18.177843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:18.178183 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:18.178524 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:18.178857 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 20:36:18.179097 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 20:36:18.180177 9638 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:18.274572 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 9432
I20260806 20:36:18.300963 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 8837
I20260806 20:36:18.302204 8947 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:18.413030 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 8837
2026-08-06T20:36:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4965 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T20:36:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:18Z Disabled control of system clock
I20260806 20:36:18.519315 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44079
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:41969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:44079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 20:36:18.860229 9730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:18.860526 9730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:18.860669 9730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:18.868168 9730 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:18.868275 9730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:18.868377 9730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:18.868468 9730 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:18.868552 9730 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:18.878109 9730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:41969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:44079
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:18.879500 9730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:18.881369 9730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:18.893296 9746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:18.893373 9741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:18.893340 9740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:18.894791 9730 server_base.cc:1034] running on GCE node
I20260806 20:36:18.895607 9730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:18.897092 9730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:18.898336 9730 hybrid_clock.cc:648] HybridClock initialized: now 1786048578898302 us; error 45 us; skew 500 ppm
I20260806 20:36:18.898693 9730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:18.901098 9730 webserver.cc:460] Webserver started at http://127.13.149.126:44157/ using document root <none> and password file <none>
I20260806 20:36:18.901804 9730 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:18.901942 9730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:18.902302 9730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:18.905246 9730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "6018ecce901149b5a2a3be6d5800003a"
format_stamp: "Formatted at 2026-08-06 20:36:18 on dist-test-slave-2kcd"
server_key: "4e5305d520f094f5dd19c2ff06351f78"
server_key_iv: "5ef72923615a9704a67cb3e655913438"
server_key_version: "encryptionkey@0"
I20260806 20:36:18.906078 9730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "6018ecce901149b5a2a3be6d5800003a"
format_stamp: "Formatted at 2026-08-06 20:36:18 on dist-test-slave-2kcd"
server_key: "4e5305d520f094f5dd19c2ff06351f78"
server_key_iv: "5ef72923615a9704a67cb3e655913438"
server_key_version: "encryptionkey@0"
I20260806 20:36:18.911187 9730 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 20:36:18.914623 9752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:18.915938 9730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:36:18.916129 9730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "6018ecce901149b5a2a3be6d5800003a"
format_stamp: "Formatted at 2026-08-06 20:36:18 on dist-test-slave-2kcd"
server_key: "4e5305d520f094f5dd19c2ff06351f78"
server_key_iv: "5ef72923615a9704a67cb3e655913438"
server_key_version: "encryptionkey@0"
I20260806 20:36:18.916358 9730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:18.952713 9730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:18.953800 9730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:18.954155 9730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:18.973405 9730 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:44079
I20260806 20:36:18.973456 9840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:44079 every 8 connection(s)
I20260806 20:36:18.974792 9730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:18.976931 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 9730
I20260806 20:36:18.977134 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:18.977643 13909 external_mini_cluster.cc:1428] Setting key 64792fff0adabedff733e8d52c1f3552
I20260806 20:36:18.979130 9841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:18.993695 9844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:18.979603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59386 (local address 127.13.149.126:44079)
0806 20:36:18.980818 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:18.980833 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:18.980890 (+ 57us) server_negotiation.cc:407] Connection header received
0806 20:36:18.982831 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:18.982863 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:18.983489 (+ 626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:18.983967 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:18.984544 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:18.986725 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:18.988167 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:18.989290 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:18.989506 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:18.990632 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:18.990644 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:18.990661 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:18.991475 (+ 814us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:18.991571 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:18.991608 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:18.991735 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:18.991992 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 20:36:18.992352 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":389,"threads_started":1}
I20260806 20:36:18.995014 9841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a: Bootstrap starting.
I20260806 20:36:18.998258 9841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:18.999310 9841 log.cc:824] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:19.002172 9841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a: No bootstrap required, opened a new log
I20260806 20:36:19.009693 9841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018ecce901149b5a2a3be6d5800003a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44079 } }
I20260806 20:36:19.010071 9841 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:19.010211 9841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6018ecce901149b5a2a3be6d5800003a, State: Initialized, Role: FOLLOWER
I20260806 20:36:19.010780 9841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018ecce901149b5a2a3be6d5800003a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44079 } }
I20260806 20:36:19.011031 9841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:19.011214 9841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:19.011454 9841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:19.013893 9841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018ecce901149b5a2a3be6d5800003a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44079 } }
I20260806 20:36:19.014379 9841 leader_election.cc:302] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6018ecce901149b5a2a3be6d5800003a; no voters:
I20260806 20:36:19.014927 9841 leader_election.cc:288] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:19.015102 9846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:19.015872 9846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [term 1 LEADER]: Becoming Leader. State: Replica: 6018ecce901149b5a2a3be6d5800003a, State: Running, Role: LEADER
I20260806 20:36:19.016387 9846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018ecce901149b5a2a3be6d5800003a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44079 } }
I20260806 20:36:19.017395 9841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:19.019500 9847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6018ecce901149b5a2a3be6d5800003a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018ecce901149b5a2a3be6d5800003a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44079 } } }
I20260806 20:36:19.019944 9847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:19.019717 9848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6018ecce901149b5a2a3be6d5800003a. Latest consensus state: current_term: 1 leader_uuid: "6018ecce901149b5a2a3be6d5800003a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018ecce901149b5a2a3be6d5800003a" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44079 } } }
I20260806 20:36:19.020139 9848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:19.022188 9852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:19.027078 9852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:19.037137 9852 catalog_manager.cc:1347] Generated new cluster ID: 83ff6d2db1f54487b5c3c91754a71eda
I20260806 20:36:19.037243 9852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:19.049942 9852 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:19.051173 9852 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:19.065330 9852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a: Generated new TSK 0
I20260806 20:36:19.066138 9852 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:19.071628 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44079
--builtin_ntp_servers=127.13.149.84:41969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 20:36:19.419317 9871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:19.419623 9871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:19.419787 9871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:19.426972 9871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:19.427065 9871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:19.427222 9871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:36:19.436232 9871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:41969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44079
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:19.437500 9871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:19.439311 9871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:19.453500 9882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:19.453598 9883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:19.453562 9885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:19.454691 9871 server_base.cc:1034] running on GCE node
I20260806 20:36:19.455369 9871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:19.456331 9871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:19.457587 9871 hybrid_clock.cc:648] HybridClock initialized: now 1786048579457547 us; error 60 us; skew 500 ppm
I20260806 20:36:19.457938 9871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:19.460274 9871 webserver.cc:460] Webserver started at http://127.13.149.65:38951/ using document root <none> and password file <none>
I20260806 20:36:19.461056 9871 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:19.461189 9871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:19.461512 9871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:19.464474 9871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "6aff81c11d7a415d8410f3bbfded16a1"
format_stamp: "Formatted at 2026-08-06 20:36:19 on dist-test-slave-2kcd"
server_key: "0553071d12182c3cb805409b82b2958c"
server_key_iv: "422a9c730019dd41f614f896b4f8ae27"
server_key_version: "encryptionkey@0"
I20260806 20:36:19.465283 9871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "6aff81c11d7a415d8410f3bbfded16a1"
format_stamp: "Formatted at 2026-08-06 20:36:19 on dist-test-slave-2kcd"
server_key: "0553071d12182c3cb805409b82b2958c"
server_key_iv: "422a9c730019dd41f614f896b4f8ae27"
server_key_version: "encryptionkey@0"
I20260806 20:36:19.470419 9871 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:36:19.473951 9896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:19.475261 9871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:36:19.475454 9871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "6aff81c11d7a415d8410f3bbfded16a1"
format_stamp: "Formatted at 2026-08-06 20:36:19 on dist-test-slave-2kcd"
server_key: "0553071d12182c3cb805409b82b2958c"
server_key_iv: "422a9c730019dd41f614f896b4f8ae27"
server_key_version: "encryptionkey@0"
I20260806 20:36:19.475673 9871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:19.490302 9871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:19.491073 9871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:19.491380 9871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:19.492331 9871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:19.493851 9871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:19.493975 9871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:19.494102 9871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:19.494185 9871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:19.529042 9871 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:33727
I20260806 20:36:19.529081 10091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:33727 every 8 connection(s)
I20260806 20:36:19.530390 9871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:36:19.534484 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 9871
I20260806 20:36:19.534682 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:36:19.535266 13909 external_mini_cluster.cc:1428] Setting key 2f792d3738320616922f6ab1a898bfa6
I20260806 20:36:19.538549 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44079
--builtin_ntp_servers=127.13.149.84:41969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 20:36:19.544653 10097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:19.532869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:60343 (local address 127.13.149.126:44079)
0806 20:36:19.533293 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:19.533297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:19.534601 (+ 1304us) server_negotiation.cc:407] Connection header received
0806 20:36:19.536860 (+ 2259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:19.536866 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:19.536954 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:19.537111 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:19.538551 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:19.539362 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:19.541860 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:19.542257 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:19.542353 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:19.543938 (+ 1585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:19.543943 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:19.543946 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:19.543963 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:19.544001 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:19.544013 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:19.544083 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:19.544340 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 20:36:19.544419 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":218,"threads_started":1}
I20260806 20:36:19.546128 10098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:19.533446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44079 (local address 127.13.149.65:60343)
0806 20:36:19.534392 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:19.534441 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:19.536569 (+ 2128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:19.537379 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:19.537390 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:19.537493 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:19.538362 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:19.538391 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:19.539519 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:19.539527 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:19.541704 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:19.541722 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:19.542485 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:19.542495 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:19.542807 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:19.543587 (+ 780us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:19.543592 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:19.543641 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:19.543737 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:19.544110 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:19.544123 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:19.544133 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 20:36:19.544323 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 20:36:19.544730 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":258,"threads_started":1}
I20260806 20:36:19.547663 10093 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44079
I20260806 20:36:19.547983 10093 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:19.548939 10093 heartbeater.cc:511] Master 127.13.149.126:44079 requested a full tablet report, sending...
I20260806 20:36:19.551064 9785 ts_manager.cc:194] Registered new tserver with Master: 6aff81c11d7a415d8410f3bbfded16a1 (127.13.149.65:33727)
I20260806 20:36:19.553257 9785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.65:60343
W20260806 20:36:19.886332 10099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:19.886605 10099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:19.886695 10099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:19.894032 10099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:19.894129 10099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:19.894243 10099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:36:19.903194 10099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:41969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44079
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:19.904441 10099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:19.906261 10099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:19.919342 10111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:19.919435 10106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:19.919413 10108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:19.920403 10099 server_base.cc:1034] running on GCE node
I20260806 20:36:19.921123 10099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:19.922112 10099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:19.923347 10099 hybrid_clock.cc:648] HybridClock initialized: now 1786048579923271 us; error 60 us; skew 500 ppm
I20260806 20:36:19.923712 10099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:19.926034 10099 webserver.cc:460] Webserver started at http://127.13.149.66:44027/ using document root <none> and password file <none>
I20260806 20:36:19.926715 10099 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:19.926834 10099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:19.927178 10099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:19.930274 10099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "7f86c094471147b0879bfbbb4e834e35"
format_stamp: "Formatted at 2026-08-06 20:36:19 on dist-test-slave-2kcd"
server_key: "dca4c337963d7e8e1daccf47f3982f9c"
server_key_iv: "38156c10deca38d7bfc8f49eaf27a21e"
server_key_version: "encryptionkey@0"
I20260806 20:36:19.931093 10099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "7f86c094471147b0879bfbbb4e834e35"
format_stamp: "Formatted at 2026-08-06 20:36:19 on dist-test-slave-2kcd"
server_key: "dca4c337963d7e8e1daccf47f3982f9c"
server_key_iv: "38156c10deca38d7bfc8f49eaf27a21e"
server_key_version: "encryptionkey@0"
I20260806 20:36:19.936040 10099 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:36:19.939465 10121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:19.940766 10099 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:36:19.941016 10099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "7f86c094471147b0879bfbbb4e834e35"
format_stamp: "Formatted at 2026-08-06 20:36:19 on dist-test-slave-2kcd"
server_key: "dca4c337963d7e8e1daccf47f3982f9c"
server_key_iv: "38156c10deca38d7bfc8f49eaf27a21e"
server_key_version: "encryptionkey@0"
I20260806 20:36:19.941226 10099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:19.964743 10099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:19.965502 10099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:19.965776 10099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:19.966673 10099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:19.968183 10099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:19.968271 10099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:19.968343 10099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:19.968398 10099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:20.004483 10099 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:44203
I20260806 20:36:20.004568 10298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:44203 every 8 connection(s)
I20260806 20:36:20.005825 10099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:36:20.011600 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 10099
I20260806 20:36:20.011802 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:36:20.012430 13909 external_mini_cluster.cc:1428] Setting key f68ee91dbc1754a43786e56dd9b205b6
I20260806 20:36:20.015774 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44079
--builtin_ntp_servers=127.13.149.84:41969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 20:36:20.020262 10097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.008321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:49729 (local address 127.13.149.126:44079)
0806 20:36:20.008500 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.008505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.009930 (+ 1425us) server_negotiation.cc:407] Connection header received
0806 20:36:20.011948 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.011953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.012025 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.012114 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:20.013525 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.014621 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.017107 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.017525 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.017691 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.019353 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:20.019358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:20.019361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:20.019378 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:20.019441 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:20.019458 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:20.019585 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.019912 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.020027 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 20:36:20.021591 10301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.008906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44079 (local address 127.13.149.66:49729)
0806 20:36:20.009764 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:20.009806 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:20.011591 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:20.012407 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:20.012422 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:20.012550 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:20.013310 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.013337 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.014783 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.014788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.016951 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.016970 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.017799 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.017808 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.018138 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.018986 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:20.018992 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:20.019044 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:20.019146 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:20.019611 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:20.019625 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:20.019636 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 20:36:20.019808 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 20:36:20.020211 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":273,"threads_started":1}
I20260806 20:36:20.023003 10299 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44079
I20260806 20:36:20.023300 10299 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:20.024055 10299 heartbeater.cc:511] Master 127.13.149.126:44079 requested a full tablet report, sending...
I20260806 20:36:20.025444 9785 ts_manager.cc:194] Registered new tserver with Master: 7f86c094471147b0879bfbbb4e834e35 (127.13.149.66:44203)
I20260806 20:36:20.026275 9785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.66:49729
W20260806 20:36:20.360059 10302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:20.360330 10302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:20.360491 10302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:20.367744 10302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:20.367842 10302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:20.368029 10302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:36:20.377287 10302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:41969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44079
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:20.378544 10302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:20.380424 10302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:20.394484 10309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:20.394446 10310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:20.394570 10312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:20.395087 10302 server_base.cc:1034] running on GCE node
I20260806 20:36:20.395673 10302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:20.396664 10302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:20.397924 10302 hybrid_clock.cc:648] HybridClock initialized: now 1786048580397869 us; error 73 us; skew 500 ppm
I20260806 20:36:20.398257 10302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:20.400408 10302 webserver.cc:460] Webserver started at http://127.13.149.67:43679/ using document root <none> and password file <none>
I20260806 20:36:20.401134 10302 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:20.401248 10302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:20.401589 10302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:20.404421 10302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "b0723054b394461cbc37006e8ea9c0e8"
format_stamp: "Formatted at 2026-08-06 20:36:20 on dist-test-slave-2kcd"
server_key: "85ed1c9d0092f4b49ff6178b7e45993f"
server_key_iv: "1f15ba27452810560d4737ce3c10edb0"
server_key_version: "encryptionkey@0"
I20260806 20:36:20.405200 10302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "b0723054b394461cbc37006e8ea9c0e8"
format_stamp: "Formatted at 2026-08-06 20:36:20 on dist-test-slave-2kcd"
server_key: "85ed1c9d0092f4b49ff6178b7e45993f"
server_key_iv: "1f15ba27452810560d4737ce3c10edb0"
server_key_version: "encryptionkey@0"
I20260806 20:36:20.410149 10302 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:36:20.413514 10322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:20.414716 10302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:36:20.414915 10302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "b0723054b394461cbc37006e8ea9c0e8"
format_stamp: "Formatted at 2026-08-06 20:36:20 on dist-test-slave-2kcd"
server_key: "85ed1c9d0092f4b49ff6178b7e45993f"
server_key_iv: "1f15ba27452810560d4737ce3c10edb0"
server_key_version: "encryptionkey@0"
I20260806 20:36:20.415139 10302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:20.429739 10302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:20.430519 10302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:20.430831 10302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:20.431782 10302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:20.433264 10302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:20.433387 10302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:20.433527 10302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:20.433617 10302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:20.469277 10302 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:42215
I20260806 20:36:20.469331 10521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:42215 every 8 connection(s)
I20260806 20:36:20.470649 10302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:36:20.478242 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 10302
I20260806 20:36:20.478482 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:36:20.479032 13909 external_mini_cluster.cc:1428] Setting key afc736b72ab8de9eb5dc3da1546fb315
I20260806 20:36:20.483397 10097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.473418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:33903 (local address 127.13.149.126:44079)
0806 20:36:20.473610 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.473615 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.474893 (+ 1278us) server_negotiation.cc:407] Connection header received
0806 20:36:20.476567 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.476572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.476639 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.476728 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:20.477777 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.478713 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.480620 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.481282 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.481414 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.482724 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:20.482729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:20.482732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:20.482748 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:20.482779 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:20.482790 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:20.482861 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.483081 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.483155 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 20:36:20.484290 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.473844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44079 (local address 127.13.149.67:33903)
0806 20:36:20.474720 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:20.474766 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:20.476328 (+ 1562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:20.476984 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:20.476991 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:20.477071 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:20.477623 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.477639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.478876 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.478884 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.480435 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.480451 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.481496 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.481501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.481696 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.482444 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:20.482447 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:20.482482 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:20.482552 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:20.482876 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:20.482884 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:20.482913 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 20:36:20.483050 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 20:36:20.483308 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":275,"threads_started":1}
I20260806 20:36:20.485601 10522 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44079
I20260806 20:36:20.485930 10522 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:20.486662 10522 heartbeater.cc:511] Master 127.13.149.126:44079 requested a full tablet report, sending...
I20260806 20:36:20.488000 9785 ts_manager.cc:194] Registered new tserver with Master: b0723054b394461cbc37006e8ea9c0e8 (127.13.149.67:42215)
I20260806 20:36:20.488879 9785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.67:33903
I20260806 20:36:20.494138 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:36:20.503923 10097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.498181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51802 (local address 127.13.149.126:44079)
0806 20:36:20.498324 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.498328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.498780 (+ 452us) server_negotiation.cc:407] Connection header received
0806 20:36:20.498940 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.498943 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.499008 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.499084 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:20.499521 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.500363 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.501801 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.502205 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.502331 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.503404 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:20.503408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:20.503411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:20.503425 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:20.503449 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:20.503459 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:20.503525 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.503649 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.503712 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 20:36:20.507397 9785 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:36:20.514211 9785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:36:20.553447 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.527002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43032 (local address 127.13.149.66:44203)
0806 20:36:20.543449 (+ 16447us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.543461 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.543501 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:36:20.543618 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.543629 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.543916 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.544122 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:20.545329 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.547017 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.550964 (+ 3947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.552156 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.552340 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.552631 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.552892 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.553080 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16229,"thread_start_us":16466,"threads_started":1}
I20260806 20:36:20.553464 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.526206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:44203 (local address 127.0.0.1:43032)
0806 20:36:20.542898 (+ 16692us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:20.542960 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:20.543249 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:20.544498 (+ 1249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:20.544510 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:20.544554 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:20.545141 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.545154 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.547193 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.547198 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.550600 (+ 3402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.550710 (+ 110us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.552381 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.552390 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.552587 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.552652 (+ 65us) client_negotiation.cc:769] Sending connection context
0806 20:36:20.552815 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 20:36:20.553025 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16272,"mutex_wait_us":29,"thread_start_us":16064,"threads_started":1}
I20260806 20:36:20.553998 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.526244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:42215 (local address 127.0.0.1:51958)
0806 20:36:20.545149 (+ 18905us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:20.545177 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:20.545341 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:20.546605 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:20.546609 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:20.546639 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:20.547187 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.547200 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.548658 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.548665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.550714 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.550731 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.552865 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.552874 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.553096 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.553141 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 20:36:20.553251 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 20:36:20.553440 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18692,"mutex_wait_us":58,"thread_start_us":19230,"threads_started":1}
I20260806 20:36:20.554275 10543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.527664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51958 (local address 127.13.149.67:42215)
0806 20:36:20.536507 (+ 8843us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.536523 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.545301 (+ 8778us) server_negotiation.cc:407] Connection header received
0806 20:36:20.545624 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.545634 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.545955 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.546151 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:20.547432 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.548493 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.551019 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.552334 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.552464 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.552735 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.553589 (+ 854us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.553780 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8574,"thread_start_us":8380,"threads_started":1}
I20260806 20:36:20.556239 10093 heartbeater.cc:503] Master 127.13.149.126:44079 was elected leader, sending a full tablet report...
I20260806 20:36:20.556416 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.527276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48080 (local address 127.13.149.65:33727)
0806 20:36:20.544401 (+ 17125us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.544415 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.545945 (+ 1530us) server_negotiation.cc:407] Connection header received
0806 20:36:20.546240 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.546247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.546435 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.546608 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:20.547768 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.549542 (+ 1774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.552050 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.555004 (+ 2954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.555212 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.555536 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.555741 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.555918 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16878,"thread_start_us":16685,"threads_started":1}
I20260806 20:36:20.557247 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.526668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48080)
0806 20:36:20.545761 (+ 19093us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:20.545783 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:20.546047 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:20.546832 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:20.546841 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:20.546864 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:20.547536 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.547551 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.549702 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.549708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.551822 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.551838 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.555251 (+ 3413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.555259 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.555469 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.555522 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 20:36:20.555670 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 20:36:20.555829 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18966,"mutex_wait_us":16,"thread_start_us":17957,"threads_started":1}
I20260806 20:36:20.558241 10409 tablet_service.cc:1467] Processing CreateTablet for tablet 59244dab5b274527861b1ca3ac7b2446 (DEFAULT_TABLE table=test-table [id=e8932bcacb5f4f0a84b6a5bd8d5199e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:20.558241 10193 tablet_service.cc:1467] Processing CreateTablet for tablet 59244dab5b274527861b1ca3ac7b2446 (DEFAULT_TABLE table=test-table [id=e8932bcacb5f4f0a84b6a5bd8d5199e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:20.559748 10409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59244dab5b274527861b1ca3ac7b2446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:20.559748 10193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59244dab5b274527861b1ca3ac7b2446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:20.561008 9978 tablet_service.cc:1467] Processing CreateTablet for tablet 59244dab5b274527861b1ca3ac7b2446 (DEFAULT_TABLE table=test-table [id=e8932bcacb5f4f0a84b6a5bd8d5199e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:20.562227 9978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59244dab5b274527861b1ca3ac7b2446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:20.573623 10544 tablet_bootstrap.cc:492] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: Bootstrap starting.
I20260806 20:36:20.575650 10545 tablet_bootstrap.cc:492] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Bootstrap starting.
I20260806 20:36:20.577490 10546 tablet_bootstrap.cc:492] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Bootstrap starting.
I20260806 20:36:20.578713 10544 tablet_bootstrap.cc:654] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:20.579241 10545 tablet_bootstrap.cc:654] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:20.580070 10544 log.cc:824] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:20.580488 10545 log.cc:824] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:20.580832 10546 tablet_bootstrap.cc:654] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:20.582053 10546 log.cc:824] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:20.583405 10544 tablet_bootstrap.cc:492] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: No bootstrap required, opened a new log
I20260806 20:36:20.583514 10545 tablet_bootstrap.cc:492] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: No bootstrap required, opened a new log
I20260806 20:36:20.583707 10544 ts_tablet_manager.cc:1397] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260806 20:36:20.583806 10545 ts_tablet_manager.cc:1397] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 20:36:20.585131 10546 tablet_bootstrap.cc:492] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: No bootstrap required, opened a new log
I20260806 20:36:20.585420 10546 ts_tablet_manager.cc:1397] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 20:36:20.591274 10544 raft_consensus.cc:348] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.591642 10544 raft_consensus.cc:374] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:20.591749 10544 raft_consensus.cc:729] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aff81c11d7a415d8410f3bbfded16a1, State: Initialized, Role: FOLLOWER
I20260806 20:36:20.592365 10544 consensus_queue.cc:260] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.594060 10544 ts_tablet_manager.cc:1428] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: Time spent starting tablet: real 0.010s user 0.010s sys 0.001s
I20260806 20:36:20.594367 10545 raft_consensus.cc:348] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.594784 10545 raft_consensus.cc:374] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:20.594959 10545 raft_consensus.cc:729] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0723054b394461cbc37006e8ea9c0e8, State: Initialized, Role: FOLLOWER
I20260806 20:36:20.595608 10545 consensus_queue.cc:260] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.595824 10546 raft_consensus.cc:348] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.596342 10546 raft_consensus.cc:374] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:20.596570 10546 raft_consensus.cc:729] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f86c094471147b0879bfbbb4e834e35, State: Initialized, Role: FOLLOWER
I20260806 20:36:20.597378 10522 heartbeater.cc:503] Master 127.13.149.126:44079 was elected leader, sending a full tablet report...
I20260806 20:36:20.597445 10546 consensus_queue.cc:260] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.598127 10545 ts_tablet_manager.cc:1428] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260806 20:36:20.599107 10546 ts_tablet_manager.cc:1428] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260806 20:36:20.599310 10299 heartbeater.cc:503] Master 127.13.149.126:44079 was elected leader, sending a full tablet report...
W20260806 20:36:20.722514 10523 tablet.cc:2369] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:20.757938 10300 tablet.cc:2369] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:20.782948 10096 tablet.cc:2369] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:20.796217 10553 raft_consensus.cc:482] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:36:20.796671 10553 raft_consensus.cc:504] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.798444 10553 leader_election.cc:288] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0723054b394461cbc37006e8ea9c0e8 (127.13.149.67:42215), 7f86c094471147b0879bfbbb4e834e35 (127.13.149.66:44203)
I20260806 20:36:20.805653 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.798993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:50619 (local address 127.13.149.66:44203)
0806 20:36:20.799275 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.799284 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.800027 (+ 743us) server_negotiation.cc:407] Connection header received
0806 20:36:20.800286 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.800292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.800385 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.800490 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:20.801174 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.801919 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.803870 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.804644 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.804765 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.804905 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.805245 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.805377 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 20:36:20.805675 10543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.798846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:58067 (local address 127.13.149.67:42215)
0806 20:36:20.799126 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.799136 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.800115 (+ 979us) server_negotiation.cc:407] Connection header received
0806 20:36:20.800319 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.800323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.800383 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.800491 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:20.801349 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.802152 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.803960 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.804786 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.804969 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.805038 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.805317 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.805449 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 20:36:20.805701 10560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.798692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:44203 (local address 127.13.149.65:50619)
0806 20:36:20.799877 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:20.799898 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:20.800091 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:20.800506 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:20.800511 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:20.800544 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:20.801011 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.801025 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.802057 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.802063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.803645 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.803658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.804872 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.804882 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.805059 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.805096 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 20:36:20.805184 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 20:36:20.805313 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1047,"mutex_wait_us":3,"thread_start_us":970,"threads_started":1}
I20260806 20:36:20.805825 10561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.798703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:42215 (local address 127.13.149.65:58067)
0806 20:36:20.800022 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:20.800037 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:20.800146 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:20.800512 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:20.800516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:20.800605 (+ 89us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:20.801153 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.801166 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.802295 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.802299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.803732 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:20.803745 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.805010 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.805015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:20.805134 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.805157 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 20:36:20.805272 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 20:36:20.805397 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1194,"mutex_wait_us":91,"spinlock_wait_cycles":20864,"thread_start_us":783,"threads_started":1}
I20260806 20:36:20.806819 10225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59244dab5b274527861b1ca3ac7b2446" candidate_uuid: "6aff81c11d7a415d8410f3bbfded16a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f86c094471147b0879bfbbb4e834e35" is_pre_election: true
I20260806 20:36:20.806926 10445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59244dab5b274527861b1ca3ac7b2446" candidate_uuid: "6aff81c11d7a415d8410f3bbfded16a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0723054b394461cbc37006e8ea9c0e8" is_pre_election: true
I20260806 20:36:20.807380 10225 raft_consensus.cc:2454] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aff81c11d7a415d8410f3bbfded16a1 in term 0.
I20260806 20:36:20.807416 10445 raft_consensus.cc:2454] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aff81c11d7a415d8410f3bbfded16a1 in term 0.
I20260806 20:36:20.808106 9899 leader_election.cc:302] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6aff81c11d7a415d8410f3bbfded16a1, 7f86c094471147b0879bfbbb4e834e35, b0723054b394461cbc37006e8ea9c0e8; no voters:
I20260806 20:36:20.808485 10553 raft_consensus.cc:2781] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:36:20.808658 10553 raft_consensus.cc:482] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:36:20.808780 10553 raft_consensus.cc:3037] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:20.811002 10553 raft_consensus.cc:504] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.811666 10553 leader_election.cc:288] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [CANDIDATE]: Term 1 election: Requested vote from peers b0723054b394461cbc37006e8ea9c0e8 (127.13.149.67:42215), 7f86c094471147b0879bfbbb4e834e35 (127.13.149.66:44203)
I20260806 20:36:20.812003 10445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59244dab5b274527861b1ca3ac7b2446" candidate_uuid: "6aff81c11d7a415d8410f3bbfded16a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0723054b394461cbc37006e8ea9c0e8"
I20260806 20:36:20.812157 10225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59244dab5b274527861b1ca3ac7b2446" candidate_uuid: "6aff81c11d7a415d8410f3bbfded16a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f86c094471147b0879bfbbb4e834e35"
I20260806 20:36:20.812222 10445 raft_consensus.cc:3037] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:20.812387 10225 raft_consensus.cc:3037] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:20.814481 10445 raft_consensus.cc:2454] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aff81c11d7a415d8410f3bbfded16a1 in term 1.
I20260806 20:36:20.814628 10225 raft_consensus.cc:2454] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aff81c11d7a415d8410f3bbfded16a1 in term 1.
I20260806 20:36:20.814968 9899 leader_election.cc:302] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aff81c11d7a415d8410f3bbfded16a1, b0723054b394461cbc37006e8ea9c0e8; no voters:
I20260806 20:36:20.815306 10553 raft_consensus.cc:2781] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:20.815768 10553 raft_consensus.cc:686] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6aff81c11d7a415d8410f3bbfded16a1, State: Running, Role: LEADER
I20260806 20:36:20.816217 10553 consensus_queue.cc:237] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } }
I20260806 20:36:20.821357 9785 catalog_manager.cc:5495] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6aff81c11d7a415d8410f3bbfded16a1 (127.13.149.65). New cstate: current_term: 1 leader_uuid: "6aff81c11d7a415d8410f3bbfded16a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aff81c11d7a415d8410f3bbfded16a1" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33727 } health_report { overall_health: HEALTHY } } }
I20260806 20:36:20.851780 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.846535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48092 (local address 127.13.149.65:33727)
0806 20:36:20.846741 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.846746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.846764 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:36:20.846849 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.846853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.846961 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.847087 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:36:20.847432 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.848108 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.849624 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.850082 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.850179 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.850654 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:36:20.851178 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:36:20.851296 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.851430 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.851492 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 20:36:20.859861 10445 raft_consensus.cc:1261] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 1 FOLLOWER]: Refusing update from remote peer 6aff81c11d7a415d8410f3bbfded16a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:20.859874 10225 raft_consensus.cc:1261] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 1 FOLLOWER]: Refusing update from remote peer 6aff81c11d7a415d8410f3bbfded16a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:20.860984 10553 consensus_queue.cc:1035] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0723054b394461cbc37006e8ea9c0e8" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:20.861303 10562 consensus_queue.cc:1035] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f86c094471147b0879bfbbb4e834e35" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:20.870440 10566 mvcc.cc:205] Tried to move back new op lower bound from 7315654987191705600 to 7315654987027165184. Current Snapshot: MvccSnapshot[applied={T|T < 7315654987191705600}]
I20260806 20:36:20.875890 10569 mvcc.cc:205] Tried to move back new op lower bound from 7315654987191705600 to 7315654987027165184. Current Snapshot: MvccSnapshot[applied={T|T < 7315654987191705600}]
I20260806 20:36:20.884351 9785 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:20.884632 9785 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:20.888384 9785 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6018ecce901149b5a2a3be6d5800003a: Sending DeleteTablet for 3 replicas of tablet 59244dab5b274527861b1ca3ac7b2446
I20260806 20:36:20.889567 10409 tablet_service.cc:1514] Processing DeleteTablet for tablet 59244dab5b274527861b1ca3ac7b2446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:20 UTC) from {username='slave'} at 127.0.0.1:51958
I20260806 20:36:20.889593 10193 tablet_service.cc:1514] Processing DeleteTablet for tablet 59244dab5b274527861b1ca3ac7b2446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:20 UTC) from {username='slave'} at 127.0.0.1:43032
I20260806 20:36:20.889637 9978 tablet_service.cc:1514] Processing DeleteTablet for tablet 59244dab5b274527861b1ca3ac7b2446 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:20 UTC) from {username='slave'} at 127.0.0.1:48080
I20260806 20:36:20.892551 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 9871
I20260806 20:36:20.901635 10584 tablet_replica.cc:330] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: stopping tablet replica
I20260806 20:36:20.902187 10584 raft_consensus.cc:2229] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:20.902828 10584 raft_consensus.cc:2258] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:20.905515 10584 ts_tablet_manager.cc:1905] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:20.912973 10584 ts_tablet_manager.cc:1918] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:20.913228 10584 log.cc:1196] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/59244dab5b274527861b1ca3ac7b2446
I20260806 20:36:20.913930 10584 ts_tablet_manager.cc:1939] T 59244dab5b274527861b1ca3ac7b2446 P 7f86c094471147b0879bfbbb4e834e35: Deleting consensus metadata
I20260806 20:36:20.916119 9756 catalog_manager.cc:4841] TS 7f86c094471147b0879bfbbb4e834e35 (127.13.149.66:44203): tablet 59244dab5b274527861b1ca3ac7b2446 (table test-table [id=e8932bcacb5f4f0a84b6a5bd8d5199e6]) successfully deleted
I20260806 20:36:20.918370 10582 tablet_replica.cc:330] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: stopping tablet replica
I20260806 20:36:20.918491 10581 tablet_replica.cc:330] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: stopping tablet replica
I20260806 20:36:20.919039 10581 raft_consensus.cc:2229] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:20.919096 10582 raft_consensus.cc:2229] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:36:20.919659 10581 raft_consensus.cc:2258] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:20.920413 10582 raft_consensus.cc:2258] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:20.922292 10581 ts_tablet_manager.cc:1905] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:20.922750 10582 ts_tablet_manager.cc:1905] T 59244dab5b274527861b1ca3ac7b2446 P 6aff81c11d7a415d8410f3bbfded16a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:20.926760 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:20.896420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48096 (local address 127.13.149.65:33727)
0806 20:36:20.896657 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:20.896666 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:20.917200 (+ 20534us) server_negotiation.cc:407] Connection header received
0806 20:36:20.917456 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:20.917465 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:20.917586 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:20.917686 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:20.918395 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.919688 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.922480 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:20.923143 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:20.923241 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:20.924863 (+ 1622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:20.924877 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:20.924894 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:20.925772 (+ 878us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:20.925845 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:20.925873 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:20.926005 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:20.926220 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 20:36:20.926332 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 20:36:20.928022 10085 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:20.930315 10581 ts_tablet_manager.cc:1918] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:20.930513 10581 log.cc:1196] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/59244dab5b274527861b1ca3ac7b2446
I20260806 20:36:20.931121 10581 ts_tablet_manager.cc:1939] T 59244dab5b274527861b1ca3ac7b2446 P b0723054b394461cbc37006e8ea9c0e8: Deleting consensus metadata
I20260806 20:36:20.933250 9754 catalog_manager.cc:4841] TS b0723054b394461cbc37006e8ea9c0e8 (127.13.149.67:42215): tablet 59244dab5b274527861b1ca3ac7b2446 (table test-table [id=e8932bcacb5f4f0a84b6a5bd8d5199e6]) successfully deleted
I20260806 20:36:21.028757 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 9871
W20260806 20:36:21.055472 9758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.149.65:33727 (error 108)
I20260806 20:36:21.055620 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 10099
I20260806 20:36:21.057729 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.057147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48104)
0806 20:36:21.057405 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:21.057525 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260806 20:36:21.058007 9758 catalog_manager.cc:4584] TS 6aff81c11d7a415d8410f3bbfded16a1 (127.13.149.65:33727): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 59244dab5b274527861b1ca3ac7b2446: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
I20260806 20:36:21.063021 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.056604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43036 (local address 127.13.149.66:44203)
0806 20:36:21.056880 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:21.056887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:21.056916 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:36:21.056983 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:21.056988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:21.057076 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:21.057194 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:21.057688 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:21.058641 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:21.059954 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:21.060393 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:21.060499 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:21.061549 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:21.061559 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:21.061573 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:21.062197 (+ 624us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:21.062247 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:21.062269 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:21.062378 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:21.062518 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 20:36:21.062614 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 20:36:21.063763 10291 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:21.111814 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.111240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48112)
0806 20:36:21.111501 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:21.111613 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260806 20:36:21.113148 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.112638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48122)
0806 20:36:21.112871 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:21.112976 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 20:36:21.153647 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 10099
I20260806 20:36:21.173962 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.173465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48126)
0806 20:36:21.173673 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:21.173774 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 20:36:21.175099 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.174715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48128)
0806 20:36:21.174902 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:21.174988 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 20:36:21.180943 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 10302
I20260806 20:36:21.187842 10543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.181721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51968 (local address 127.13.149.67:42215)
0806 20:36:21.181924 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:21.181931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:21.181951 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:36:21.182143 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:21.182148 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:21.182247 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:21.182364 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:21.182765 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:21.183486 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:21.184778 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:21.185300 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:21.185464 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:21.186498 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:21.186507 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:21.186522 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:21.187110 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:21.187154 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:21.187174 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:21.187307 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:21.187444 (+ 137us) server_negotiation.cc:299] Negotiation successful
0806 20:36:21.187549 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:36:21.188488 10513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:21.255649 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.255171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48130)
0806 20:36:21.255385 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:21.255477 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 20:36:21.256747 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:21.256358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33727 (local address 127.0.0.1:48142)
0806 20:36:21.256566 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:21.256636 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.65:33727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 20:36:21.274994 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 10302
I20260806 20:36:21.300911 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 9730
I20260806 20:36:21.302011 9830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:21.409435 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 9730
2026-08-06T20:36:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2990 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:21 dist-test-slave-2kcd krb5kdc[10598](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:21 dist-test-slave-2kcd krb5kdc[10598](info): set up 2 sockets
Aug 06 20:36:21 dist-test-slave-2kcd krb5kdc[10598](info): commencing operation
krb5kdc: starting...
W20260806 20:36:22.755882 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.008s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:22 dist-test-slave-2kcd krb5kdc[10598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:36:23.069322 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40081
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:40081
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:23.410069 10621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:23.410346 10621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:23.410531 10621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:23.417690 10621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:23.417783 10621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:23.417884 10621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:23.417984 10621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:23.418064 10621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:23.427502 10621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:40081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:23.428833 10621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:23.430151 10621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:23.442086 10627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:23.442157 10631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:23.442129 10628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:23.443166 10621 server_base.cc:1034] running on GCE node
I20260806 20:36:23.443915 10621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:23.445385 10621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:23.446631 10621 hybrid_clock.cc:648] HybridClock initialized: now 1786048583446590 us; error 62 us; skew 500 ppm
I20260806 20:36:23.447005 10621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:23 dist-test-slave-2kcd krb5kdc[10598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048583, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:23.453111 10621 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:36:23.454569 10621 webserver.cc:460] Webserver started at http://127.13.149.126:45143/ using document root <none> and password file <none>
I20260806 20:36:23.455251 10621 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:23.455403 10621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:23.455714 10621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:23.458757 10621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "47c8c64fd0f8458b9de6a712650759f6"
format_stamp: "Formatted at 2026-08-06 20:36:23 on dist-test-slave-2kcd"
server_key: "c4a8c55d44e7646c4e70cc249da419d7"
server_key_iv: "32618bbd4b5192686474312f6b53aefc"
server_key_version: "encryptionkey@0"
I20260806 20:36:23.459844 10621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "47c8c64fd0f8458b9de6a712650759f6"
format_stamp: "Formatted at 2026-08-06 20:36:23 on dist-test-slave-2kcd"
server_key: "c4a8c55d44e7646c4e70cc249da419d7"
server_key_iv: "32618bbd4b5192686474312f6b53aefc"
server_key_version: "encryptionkey@0"
I20260806 20:36:23.465771 10621 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 20:36:23.469231 10645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:23.470423 10621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:36:23.470616 10621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "47c8c64fd0f8458b9de6a712650759f6"
format_stamp: "Formatted at 2026-08-06 20:36:23 on dist-test-slave-2kcd"
server_key: "c4a8c55d44e7646c4e70cc249da419d7"
server_key_iv: "32618bbd4b5192686474312f6b53aefc"
server_key_version: "encryptionkey@0"
I20260806 20:36:23.470813 10621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:23.509744 10621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:23.514243 10621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:23.514565 10621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:23.534363 10621 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:40081
I20260806 20:36:23.534409 10717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:40081 every 8 connection(s)
I20260806 20:36:23.535805 10621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:23.539722 10721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:23.539747 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 10621
I20260806 20:36:23.539974 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:23.540475 13909 external_mini_cluster.cc:1428] Setting key ee82ef776ecd4e46645ae60eb78e33fd
I20260806 20:36:23.554489 10721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6: Bootstrap starting.
Aug 06 20:36:23 dist-test-slave-2kcd krb5kdc[10598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:23.558221 10721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:23.559719 10721 log.cc:824] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:23.563098 10721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6: No bootstrap required, opened a new log
I20260806 20:36:23.565937 10726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:23.542490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41126 (local address 127.13.149.126:40081)
0806 20:36:23.543388 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:23.543413 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:23.543463 (+ 50us) server_negotiation.cc:407] Connection header received
0806 20:36:23.545242 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:23.545275 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:23.545785 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:23.546236 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:23.547719 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:23.549701 (+ 1982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:23.551084 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:23.552225 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:23.552427 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:23.557221 (+ 4794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:23.557234 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:23.557256 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:23.557306 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:23.561189 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:23.561928 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:23.561936 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:23.561945 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:23.562183 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:23.562631 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:23.562636 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:23.562639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:23.563309 (+ 670us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:23.563637 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:23.564063 (+ 426us) server_negotiation.cc:299] Negotiation successful
0806 20:36:23.564502 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":371,"threads_started":1}
I20260806 20:36:23.572441 10721 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c8c64fd0f8458b9de6a712650759f6" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40081 } }
I20260806 20:36:23.572775 10721 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:23.572921 10721 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c8c64fd0f8458b9de6a712650759f6, State: Initialized, Role: FOLLOWER
I20260806 20:36:23.573472 10721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c8c64fd0f8458b9de6a712650759f6" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40081 } }
I20260806 20:36:23.573740 10721 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:23.573885 10721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:23.574088 10721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:23.576483 10721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c8c64fd0f8458b9de6a712650759f6" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40081 } }
I20260806 20:36:23.577056 10721 leader_election.cc:302] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47c8c64fd0f8458b9de6a712650759f6; no voters:
I20260806 20:36:23.577621 10721 leader_election.cc:288] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:23.577775 10728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:23.578593 10728 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [term 1 LEADER]: Becoming Leader. State: Replica: 47c8c64fd0f8458b9de6a712650759f6, State: Running, Role: LEADER
I20260806 20:36:23.579262 10728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c8c64fd0f8458b9de6a712650759f6" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40081 } }
I20260806 20:36:23.579787 10721 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:23.583222 10731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47c8c64fd0f8458b9de6a712650759f6. Latest consensus state: current_term: 1 leader_uuid: "47c8c64fd0f8458b9de6a712650759f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c8c64fd0f8458b9de6a712650759f6" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40081 } } }
I20260806 20:36:23.583922 10731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:23.583006 10730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47c8c64fd0f8458b9de6a712650759f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c8c64fd0f8458b9de6a712650759f6" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40081 } } }
I20260806 20:36:23.584568 10730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:23.585496 10740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:23.590930 10740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:23.599370 10740 catalog_manager.cc:1347] Generated new cluster ID: 119d69f3e929431084c7964ee1d2d594
I20260806 20:36:23.599475 10740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:23.623984 10740 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:23.625358 10740 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:23.633605 10740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6: Generated new TSK 0
I20260806 20:36:23.634429 10740 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:36:23.712864 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40081
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:24.056661 10759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:24.056942 10759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:24.057039 10759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:24.064055 10759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:24.064159 10759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:24.064267 10759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:36:24.075078 10759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:24.076295 10759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:24.077682 10759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:24.096266 10765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:24.096498 10773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:24.096946 10767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:24.098726 10759 server_base.cc:1034] running on GCE node
I20260806 20:36:24.099476 10759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:24.100575 10759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:24.101827 10759 hybrid_clock.cc:648] HybridClock initialized: now 1786048584101762 us; error 69 us; skew 500 ppm
I20260806 20:36:24.102252 10759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:24 dist-test-slave-2kcd krb5kdc[10598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:24.106640 10759 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:36:24.108454 10759 webserver.cc:460] Webserver started at http://127.13.149.65:35515/ using document root <none> and password file <none>
I20260806 20:36:24.109560 10759 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:24.109714 10759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:24.110052 10759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:24.114164 10759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "c7573e8bab904a8194efc7bd7d6cc931"
format_stamp: "Formatted at 2026-08-06 20:36:24 on dist-test-slave-2kcd"
server_key: "34617f19ba515d8daaffa99e9c07052c"
server_key_iv: "a36ccc255badc2c13152f9a2768a709e"
server_key_version: "encryptionkey@0"
I20260806 20:36:24.115295 10759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "c7573e8bab904a8194efc7bd7d6cc931"
format_stamp: "Formatted at 2026-08-06 20:36:24 on dist-test-slave-2kcd"
server_key: "34617f19ba515d8daaffa99e9c07052c"
server_key_iv: "a36ccc255badc2c13152f9a2768a709e"
server_key_version: "encryptionkey@0"
I20260806 20:36:24.123122 10759 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260806 20:36:24.128444 10782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:24.130298 10759 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 20:36:24.130519 10759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "c7573e8bab904a8194efc7bd7d6cc931"
format_stamp: "Formatted at 2026-08-06 20:36:24 on dist-test-slave-2kcd"
server_key: "34617f19ba515d8daaffa99e9c07052c"
server_key_iv: "a36ccc255badc2c13152f9a2768a709e"
server_key_version: "encryptionkey@0"
I20260806 20:36:24.130800 10759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:24.148120 10759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:24.152374 10759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:24.152645 10759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:24.153681 10759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:24.155022 10759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:24.155104 10759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:24.155189 10759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:24.155242 10759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:24.189692 10759 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:36055
I20260806 20:36:24.189736 10958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:36055 every 8 connection(s)
I20260806 20:36:24.191015 10759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:36:24.193917 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 10759
I20260806 20:36:24.194125 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:36:24.194620 13909 external_mini_cluster.cc:1428] Setting key 1e4b5533907b77a780d583b4b62d2f06
Aug 06 20:36:24 dist-test-slave-2kcd krb5kdc[10598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:24.212637 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:24.193694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:42661 (local address 127.13.149.126:40081)
0806 20:36:24.194213 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:24.194219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:24.196865 (+ 2646us) server_negotiation.cc:407] Connection header received
0806 20:36:24.197395 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:24.197401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:24.197498 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:24.197633 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:24.199208 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.199935 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.201607 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.202035 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.202170 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:24.205742 (+ 3572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:24.205751 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:24.205758 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:24.205804 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:24.209465 (+ 3661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:24.210353 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:24.210357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:24.210359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:24.210474 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:24.211012 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:24.211015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:24.211017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:24.211256 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:24.211365 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:24.212234 (+ 869us) server_negotiation.cc:299] Negotiation successful
0806 20:36:24.212394 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":237,"threads_started":1}
I20260806 20:36:24.214255 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:24.194317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:40081 (local address 127.13.149.65:42661)
0806 20:36:24.195211 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:24.195266 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:24.197135 (+ 1869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:24.197867 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:24.197875 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:24.198484 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:24.199041 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:24.199057 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.200109 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.200113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:24.201461 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:24.201474 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.202278 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.202285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:24.202524 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:24.203250 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:24.203271 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:24.205513 (+ 2242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:24.209625 (+ 4112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:24.209631 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:24.209642 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:24.210195 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:24.210584 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:24.210591 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:24.210595 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:24.210849 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:24.211384 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:24.211395 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:24.211827 (+ 432us) client_negotiation.cc:769] Sending connection context
0806 20:36:24.212126 (+ 299us) client_negotiation.cc:240] Negotiation successful
0806 20:36:24.212685 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":335,"threads_started":1}
I20260806 20:36:24.215859 10959 heartbeater.cc:347] Connected to a master server at 127.13.149.126:40081
I20260806 20:36:24.216185 10959 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:24.216951 10959 heartbeater.cc:511] Master 127.13.149.126:40081 requested a full tablet report, sending...
I20260806 20:36:24.218978 10669 ts_manager.cc:194] Registered new tserver with Master: c7573e8bab904a8194efc7bd7d6cc931 (127.13.149.65:36055)
I20260806 20:36:24.220361 10669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:42661
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:36:24.268208 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40081
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:24.619537 10968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:24.619875 10968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:24.620052 10968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:24.628085 10968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:24.628254 10968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:24.628438 10968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:36:24.638608 10968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:24.639961 10968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:24.641419 10968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:24.654711 10975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:24.654780 10976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:24.654786 10978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:24.655771 10968 server_base.cc:1034] running on GCE node
I20260806 20:36:24.656370 10968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:24.657368 10968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:24.658622 10968 hybrid_clock.cc:648] HybridClock initialized: now 1786048584658579 us; error 54 us; skew 500 ppm
I20260806 20:36:24.659005 10968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:24 dist-test-slave-2kcd krb5kdc[10598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:24.662436 10968 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:36:24.663981 10968 webserver.cc:460] Webserver started at http://127.13.149.66:38313/ using document root <none> and password file <none>
I20260806 20:36:24.664688 10968 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:24.664882 10968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:24.665225 10968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:24.668217 10968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a"
format_stamp: "Formatted at 2026-08-06 20:36:24 on dist-test-slave-2kcd"
server_key: "f6b8eaab0ea410b200ac1fa44ef6fce8"
server_key_iv: "91f54116db073c4ee89d0dda8159547d"
server_key_version: "encryptionkey@0"
I20260806 20:36:24.669104 10968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a"
format_stamp: "Formatted at 2026-08-06 20:36:24 on dist-test-slave-2kcd"
server_key: "f6b8eaab0ea410b200ac1fa44ef6fce8"
server_key_iv: "91f54116db073c4ee89d0dda8159547d"
server_key_version: "encryptionkey@0"
I20260806 20:36:24.674458 10968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:36:24.678103 10991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:24.679606 10968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:36:24.679769 10968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a"
format_stamp: "Formatted at 2026-08-06 20:36:24 on dist-test-slave-2kcd"
server_key: "f6b8eaab0ea410b200ac1fa44ef6fce8"
server_key_iv: "91f54116db073c4ee89d0dda8159547d"
server_key_version: "encryptionkey@0"
I20260806 20:36:24.679976 10968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:24.716614 10968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:24.721529 10968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:24.721843 10968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:24.722887 10968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:24.724366 10968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:24.724457 10968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:24.724644 10968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:24.724696 10968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:24.759547 10968 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:40573
I20260806 20:36:24.759631 11145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:40573 every 8 connection(s)
I20260806 20:36:24.760885 10968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:36:24.761363 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 10968
I20260806 20:36:24.761574 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:36:24.762226 13909 external_mini_cluster.cc:1428] Setting key dc92c081248e3a982a86358e64dcd6c2
Aug 06 20:36:24 dist-test-slave-2kcd krb5kdc[10598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:24.783332 11148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:24.763642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:58375 (local address 127.13.149.126:40081)
0806 20:36:24.764150 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:24.764154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:24.765554 (+ 1400us) server_negotiation.cc:407] Connection header received
0806 20:36:24.767461 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:24.767469 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:24.767562 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:24.767694 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:24.769447 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.770158 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.771724 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.772170 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.772308 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:24.776597 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:24.776602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:24.776606 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:24.776640 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:24.779836 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:24.780612 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:24.780621 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:24.780627 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:24.780808 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:24.781255 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:24.781263 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:24.781270 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:24.781660 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:24.781817 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:24.782544 (+ 727us) server_negotiation.cc:299] Negotiation successful
0806 20:36:24.782814 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":297,"threads_started":1}
I20260806 20:36:24.784016 11153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:24.764387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:40081 (local address 127.13.149.66:58375)
0806 20:36:24.765348 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:24.765419 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:24.767184 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:24.767952 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:24.767960 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:24.768535 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:24.769222 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:24.769241 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.770317 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.770322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:24.771567 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:24.771580 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:24.772408 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:24.772416 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:24.772661 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:24.773421 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:24.773442 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:24.776364 (+ 2922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:24.779999 (+ 3635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:24.780019 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:24.780033 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:24.780467 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:24.780922 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:24.780926 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:24.780928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:24.781119 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:24.781789 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:24.781795 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:24.782131 (+ 336us) client_negotiation.cc:769] Sending connection context
0806 20:36:24.782359 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 20:36:24.782752 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":457,"threads_started":1}
I20260806 20:36:24.785499 11146 heartbeater.cc:347] Connected to a master server at 127.13.149.126:40081
I20260806 20:36:24.785934 11146 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:24.786859 11146 heartbeater.cc:511] Master 127.13.149.126:40081 requested a full tablet report, sending...
I20260806 20:36:24.788545 10669 ts_manager.cc:194] Registered new tserver with Master: bb0cbc49e7c6466a8c1f1d0f5c88f43a (127.13.149.66:40573)
I20260806 20:36:24.789884 10669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:58375
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:36:24.836158 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40081
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:25.170972 11160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:25.171243 11160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:25.171336 11160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:25.178699 11160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:25.178807 11160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:25.178925 11160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:36:25.189008 11160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:40081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:25.190411 11160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:25.191713 11160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:25.204936 11168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:25.204883 11169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:25.204972 11171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:25.205721 11160 server_base.cc:1034] running on GCE node
I20260806 20:36:25.206353 11160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:25.207218 11160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:25.208456 11160 hybrid_clock.cc:648] HybridClock initialized: now 1786048585208406 us; error 44 us; skew 500 ppm
I20260806 20:36:25.208832 11160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:25 dist-test-slave-2kcd krb5kdc[10598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048585, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:25.211869 11160 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:36:25.213408 11160 webserver.cc:460] Webserver started at http://127.13.149.67:46849/ using document root <none> and password file <none>
I20260806 20:36:25.214079 11160 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:25.214226 11160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:25.214545 11160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:25.217473 11160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "0ff197d8a2ab494f9e97452a9b000549"
format_stamp: "Formatted at 2026-08-06 20:36:25 on dist-test-slave-2kcd"
server_key: "189af50c0db298dd9abb3c046f1757d6"
server_key_iv: "24a2110d92a282e480a3a87a2e0ec2ba"
server_key_version: "encryptionkey@0"
I20260806 20:36:25.218241 11160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "0ff197d8a2ab494f9e97452a9b000549"
format_stamp: "Formatted at 2026-08-06 20:36:25 on dist-test-slave-2kcd"
server_key: "189af50c0db298dd9abb3c046f1757d6"
server_key_iv: "24a2110d92a282e480a3a87a2e0ec2ba"
server_key_version: "encryptionkey@0"
I20260806 20:36:25.223140 10959 heartbeater.cc:503] Master 127.13.149.126:40081 was elected leader, sending a full tablet report...
I20260806 20:36:25.223392 11160 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:36:25.227291 11179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:25.228615 11160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 20:36:25.228832 11160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "0ff197d8a2ab494f9e97452a9b000549"
format_stamp: "Formatted at 2026-08-06 20:36:25 on dist-test-slave-2kcd"
server_key: "189af50c0db298dd9abb3c046f1757d6"
server_key_iv: "24a2110d92a282e480a3a87a2e0ec2ba"
server_key_version: "encryptionkey@0"
I20260806 20:36:25.229058 11160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:25.249647 11160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:25.253618 11160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:25.253923 11160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:25.254896 11160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:25.256274 11160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:25.256381 11160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:25.256536 11160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:25.256610 11160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:25.291168 11160 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:39869
I20260806 20:36:25.291217 11358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:39869 every 8 connection(s)
I20260806 20:36:25.292475 11160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:36:25.296067 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 11160
I20260806 20:36:25.296293 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:36:25.296929 13909 external_mini_cluster.cc:1428] Setting key 32b0df262798b2f7b091162e453d7dfc
Aug 06 20:36:25 dist-test-slave-2kcd krb5kdc[10598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048585, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:25.313325 11367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.295324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:38365 (local address 127.13.149.126:40081)
0806 20:36:25.295785 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.295789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.296898 (+ 1109us) server_negotiation.cc:407] Connection header received
0806 20:36:25.299105 (+ 2207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.299111 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.299207 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.299325 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:25.300825 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.301662 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.303215 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.303602 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.303746 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.307241 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:25.307245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:25.307248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:25.307337 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:25.310193 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.310891 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.310896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.310900 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.311046 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.311472 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.311479 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.311482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.311864 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:25.312027 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.312686 (+ 659us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.312950 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":234,"threads_started":1}
I20260806 20:36:25.314270 11368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.295907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:40081 (local address 127.13.149.67:38365)
0806 20:36:25.296708 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:25.296752 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:25.298837 (+ 2085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:25.299571 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:25.299579 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:25.300098 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:25.300639 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.300656 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.301844 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.301849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.303066 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.303077 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.303824 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.303831 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.304058 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.304726 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:25.304753 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:25.307001 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:25.310336 (+ 3335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:25.310344 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:25.310358 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:25.310763 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:25.311160 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:25.311165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:25.311169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:25.311352 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:25.311988 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:25.311995 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:25.312326 (+ 331us) client_negotiation.cc:769] Sending connection context
0806 20:36:25.312595 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 20:36:25.313133 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":337,"threads_started":1}
I20260806 20:36:25.315523 11361 heartbeater.cc:347] Connected to a master server at 127.13.149.126:40081
I20260806 20:36:25.315820 11361 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:25.316573 11361 heartbeater.cc:511] Master 127.13.149.126:40081 requested a full tablet report, sending...
I20260806 20:36:25.317987 10669 ts_manager.cc:194] Registered new tserver with Master: 0ff197d8a2ab494f9e97452a9b000549 (127.13.149.67:39869)
I20260806 20:36:25.318786 10669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:38365
I20260806 20:36:25.324175 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:36:25.342087 11367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.328259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41140 (local address 127.13.149.126:40081)
0806 20:36:25.328462 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.328470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.328824 (+ 354us) server_negotiation.cc:407] Connection header received
0806 20:36:25.329035 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.329040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.329116 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.329218 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:25.330675 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.331411 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.332903 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.333400 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.333554 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.336400 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:25.336407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:25.336412 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:25.336460 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:25.339090 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.339853 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.339858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.339862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.340008 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.340479 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.340483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.340486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.340901 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:25.341183 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.341597 (+ 414us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.341790 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 20:36:25.346032 10669 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:36:25.353016 10669 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:36:25.376087 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.365501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46408 (local address 127.13.149.65:36055)
0806 20:36:25.367032 (+ 1531us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.367042 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.367069 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:36:25.367161 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.367168 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.367371 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.368474 (+ 1103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:25.368747 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.370321 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.373242 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.374678 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.374838 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.375114 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.375597 (+ 483us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.375753 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1350,"thread_start_us":1658,"threads_started":1}
I20260806 20:36:25.376192 11388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.365077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:40573 (local address 127.0.0.1:48216)
0806 20:36:25.366399 (+ 1322us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:25.366414 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:25.366632 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:25.367577 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:25.367585 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:25.367624 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:25.368275 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.368294 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.370396 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.370403 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.373231 (+ 2828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.373249 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.375234 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.375239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.375425 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.375460 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 20:36:25.375550 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 20:36:25.375677 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1210,"mutex_wait_us":1237,"spinlock_wait_cycles":768,"thread_start_us":595,"threads_started":1}
I20260806 20:36:25.376181 11386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.365127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48216 (local address 127.13.149.66:40573)
0806 20:36:25.365718 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.365728 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.366520 (+ 792us) server_negotiation.cc:407] Connection header received
0806 20:36:25.366833 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.366841 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.367087 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.367248 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:25.368511 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.370206 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.373377 (+ 3171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.374702 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.374861 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.375076 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.375619 (+ 543us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.375806 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":298,"threads_started":1}
I20260806 20:36:25.377004 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.365062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:36055 (local address 127.0.0.1:46408)
0806 20:36:25.366202 (+ 1140us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:25.366257 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:25.366444 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:25.367577 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:25.367585 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:25.367631 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:25.368332 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.368346 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.370456 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.370460 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.373070 (+ 2610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.373086 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.374908 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.374915 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.375134 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.375214 (+ 80us) client_negotiation.cc:769] Sending connection context
0806 20:36:25.375377 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 20:36:25.376579 (+ 1202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"mutex_wait_us":1059,"spinlock_wait_cycles":4608,"thread_start_us":634,"threads_started":1}
I20260806 20:36:25.380601 11389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.366678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:39869 (local address 127.0.0.1:52590)
0806 20:36:25.371391 (+ 4713us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:25.371408 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:25.371530 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:25.372240 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:25.372244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:25.372269 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:25.372687 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.372697 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.374904 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.374909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.377945 (+ 3036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.377963 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.379789 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.379797 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.379964 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.379998 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 20:36:25.380090 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 20:36:25.380223 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4596,"thread_start_us":4468,"threads_started":1}
I20260806 20:36:25.380684 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.367280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52590 (local address 127.13.149.67:39869)
0806 20:36:25.371807 (+ 4527us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.371813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.371838 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:36:25.371909 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.371913 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.372052 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.372246 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:25.372911 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.374735 (+ 1824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.378120 (+ 3385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.379527 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.379683 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.379904 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.380180 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.380346 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4390,"thread_start_us":4238,"threads_started":1}
I20260806 20:36:25.380770 11060 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef02a0703a540138b1be994c3d210b2 (DEFAULT_TABLE table=test-table [id=919ad5427dac4f338a230f6f1b7aaa0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:25.380810 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef02a0703a540138b1be994c3d210b2 (DEFAULT_TABLE table=test-table [id=919ad5427dac4f338a230f6f1b7aaa0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:25.382261 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef02a0703a540138b1be994c3d210b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:25.382300 11060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef02a0703a540138b1be994c3d210b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:25.384768 11264 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef02a0703a540138b1be994c3d210b2 (DEFAULT_TABLE table=test-table [id=919ad5427dac4f338a230f6f1b7aaa0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:25.386356 11264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef02a0703a540138b1be994c3d210b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:25.394614 11392 tablet_bootstrap.cc:492] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Bootstrap starting.
I20260806 20:36:25.398298 11396 tablet_bootstrap.cc:492] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Bootstrap starting.
I20260806 20:36:25.398913 11392 tablet_bootstrap.cc:654] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:25.400314 11392 log.cc:824] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:25.400740 11397 tablet_bootstrap.cc:492] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Bootstrap starting.
I20260806 20:36:25.402164 11396 tablet_bootstrap.cc:654] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:25.403496 11397 tablet_bootstrap.cc:654] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:25.403685 11396 log.cc:824] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:25.404560 11397 log.cc:824] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:25.407048 11396 tablet_bootstrap.cc:492] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: No bootstrap required, opened a new log
I20260806 20:36:25.407348 11396 ts_tablet_manager.cc:1397] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260806 20:36:25.407423 11392 tablet_bootstrap.cc:492] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: No bootstrap required, opened a new log
I20260806 20:36:25.407686 11392 ts_tablet_manager.cc:1397] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20260806 20:36:25.407904 11397 tablet_bootstrap.cc:492] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: No bootstrap required, opened a new log
I20260806 20:36:25.408087 11397 ts_tablet_manager.cc:1397] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 20:36:25.414877 11397 raft_consensus.cc:348] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.415239 11397 raft_consensus.cc:374] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:25.415347 11397 raft_consensus.cc:729] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ff197d8a2ab494f9e97452a9b000549, State: Initialized, Role: FOLLOWER
I20260806 20:36:25.415979 11397 consensus_queue.cc:260] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.417809 11397 ts_tablet_manager.cc:1428] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260806 20:36:25.418340 11361 heartbeater.cc:503] Master 127.13.149.126:40081 was elected leader, sending a full tablet report...
I20260806 20:36:25.418064 11396 raft_consensus.cc:348] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.418483 11396 raft_consensus.cc:374] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:25.418591 11396 raft_consensus.cc:729] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb0cbc49e7c6466a8c1f1d0f5c88f43a, State: Initialized, Role: FOLLOWER
I20260806 20:36:25.418064 11392 raft_consensus.cc:348] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.419147 11392 raft_consensus.cc:374] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:25.419276 11392 raft_consensus.cc:729] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7573e8bab904a8194efc7bd7d6cc931, State: Initialized, Role: FOLLOWER
I20260806 20:36:25.419166 11396 consensus_queue.cc:260] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.419888 11392 consensus_queue.cc:260] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.420317 11146 heartbeater.cc:503] Master 127.13.149.126:40081 was elected leader, sending a full tablet report...
I20260806 20:36:25.421056 11396 ts_tablet_manager.cc:1428] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260806 20:36:25.422693 11392 ts_tablet_manager.cc:1428] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260806 20:36:25.443365 10961 tablet.cc:2369] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:25.513278 11147 tablet.cc:2369] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:25.544236 11366 tablet.cc:2369] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:25.587805 11407 raft_consensus.cc:482] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:36:25.588195 11407 raft_consensus.cc:504] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.590109 11407 leader_election.cc:288] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb0cbc49e7c6466a8c1f1d0f5c88f43a (127.13.149.66:40573), c7573e8bab904a8194efc7bd7d6cc931 (127.13.149.65:36055)
I20260806 20:36:25.596689 11386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.590562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:40329 (local address 127.13.149.66:40573)
0806 20:36:25.590781 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.590790 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.590815 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:36:25.591033 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.591038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.591099 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.591205 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:25.591652 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.592700 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.594697 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.595887 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.596013 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.596065 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.596404 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.596495 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:36:25.596822 11368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.590304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:40573 (local address 127.13.149.67:40329)
0806 20:36:25.590637 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:25.590658 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:25.590790 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:25.591234 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:25.591239 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:25.591268 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:25.591466 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.591476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.592878 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.592912 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.594530 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.594545 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.596045 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.596051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.596235 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.596271 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 20:36:25.596375 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 20:36:25.596507 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":23}
I20260806 20:36:25.597898 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.590724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:46401 (local address 127.13.149.65:36055)
0806 20:36:25.590960 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.590968 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.591587 (+ 619us) server_negotiation.cc:407] Connection header received
0806 20:36:25.591753 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.591757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.591814 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.591884 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:25.592532 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.593601 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.595723 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.596907 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.597074 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.597151 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.597522 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.597648 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:36:25.597999 11410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.590633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:36055 (local address 127.13.149.67:46401)
0806 20:36:25.591462 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:25.591477 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:25.591616 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:25.591940 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:25.591947 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:25.591977 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:25.592328 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.592340 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.593763 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.593767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.595547 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:25.595563 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.597235 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.597239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:25.597352 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.597375 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 20:36:25.597496 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 20:36:25.597627 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":23,"thread_start_us":467,"threads_started":1}
I20260806 20:36:25.597872 11084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef02a0703a540138b1be994c3d210b2" candidate_uuid: "0ff197d8a2ab494f9e97452a9b000549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" is_pre_election: true
I20260806 20:36:25.598445 11084 raft_consensus.cc:2454] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ff197d8a2ab494f9e97452a9b000549 in term 0.
I20260806 20:36:25.598963 10892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef02a0703a540138b1be994c3d210b2" candidate_uuid: "0ff197d8a2ab494f9e97452a9b000549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7573e8bab904a8194efc7bd7d6cc931" is_pre_election: true
I20260806 20:36:25.599169 11187 leader_election.cc:302] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ff197d8a2ab494f9e97452a9b000549, bb0cbc49e7c6466a8c1f1d0f5c88f43a; no voters:
I20260806 20:36:25.599509 10892 raft_consensus.cc:2454] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ff197d8a2ab494f9e97452a9b000549 in term 0.
I20260806 20:36:25.599617 11407 raft_consensus.cc:2781] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:36:25.599810 11407 raft_consensus.cc:482] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:36:25.599978 11407 raft_consensus.cc:3037] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:25.602322 11407 raft_consensus.cc:504] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.602916 11407 leader_election.cc:288] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [CANDIDATE]: Term 1 election: Requested vote from peers bb0cbc49e7c6466a8c1f1d0f5c88f43a (127.13.149.66:40573), c7573e8bab904a8194efc7bd7d6cc931 (127.13.149.65:36055)
I20260806 20:36:25.603375 10892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef02a0703a540138b1be994c3d210b2" candidate_uuid: "0ff197d8a2ab494f9e97452a9b000549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7573e8bab904a8194efc7bd7d6cc931"
I20260806 20:36:25.603358 11084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef02a0703a540138b1be994c3d210b2" candidate_uuid: "0ff197d8a2ab494f9e97452a9b000549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a"
I20260806 20:36:25.603571 10892 raft_consensus.cc:3037] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:25.603585 11084 raft_consensus.cc:3037] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:25.606128 11084 raft_consensus.cc:2454] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ff197d8a2ab494f9e97452a9b000549 in term 1.
I20260806 20:36:25.606141 10892 raft_consensus.cc:2454] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ff197d8a2ab494f9e97452a9b000549 in term 1.
I20260806 20:36:25.606542 11187 leader_election.cc:302] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ff197d8a2ab494f9e97452a9b000549, bb0cbc49e7c6466a8c1f1d0f5c88f43a; no voters:
I20260806 20:36:25.606829 11407 raft_consensus.cc:2781] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:25.607244 11407 raft_consensus.cc:686] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 1 LEADER]: Becoming Leader. State: Replica: 0ff197d8a2ab494f9e97452a9b000549, State: Running, Role: LEADER
I20260806 20:36:25.607779 11407 consensus_queue.cc:237] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } }
I20260806 20:36:25.612246 10668 catalog_manager.cc:5495] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ff197d8a2ab494f9e97452a9b000549 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "0ff197d8a2ab494f9e97452a9b000549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ff197d8a2ab494f9e97452a9b000549" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 39869 } health_report { overall_health: HEALTHY } } }
I20260806 20:36:25.674580 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.669326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52596 (local address 127.13.149.67:39869)
0806 20:36:25.669528 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.669532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.669550 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:36:25.669632 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.669635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.669719 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.669852 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:36:25.670236 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.670971 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.672332 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.672732 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.672936 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.673478 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:36:25.673980 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:36:25.674108 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.674254 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.674323 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 20:36:25.682559 11084 raft_consensus.cc:1261] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 1 FOLLOWER]: Refusing update from remote peer 0ff197d8a2ab494f9e97452a9b000549: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:25.682564 10892 raft_consensus.cc:1261] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 1 FOLLOWER]: Refusing update from remote peer 0ff197d8a2ab494f9e97452a9b000549: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:25.683627 11411 consensus_queue.cc:1035] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb0cbc49e7c6466a8c1f1d0f5c88f43a" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 40573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:25.684060 11407 consensus_queue.cc:1035] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7573e8bab904a8194efc7bd7d6cc931" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 36055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:25.696555 11416 mvcc.cc:205] Tried to move back new op lower bound from 7315655006946013184 to 7315655006653591552. Current Snapshot: MvccSnapshot[applied={T|T < 7315655006946013184}]
I20260806 20:36:25.712900 10668 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:25.713166 10668 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:25.716970 10668 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47c8c64fd0f8458b9de6a712650759f6: Sending DeleteTablet for 3 replicas of tablet 5ef02a0703a540138b1be994c3d210b2
I20260806 20:36:25.718106 11060 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef02a0703a540138b1be994c3d210b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:25 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:48216
I20260806 20:36:25.718204 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef02a0703a540138b1be994c3d210b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:25 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:46408
I20260806 20:36:25.718431 11264 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef02a0703a540138b1be994c3d210b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:25 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:52590
I20260806 20:36:25.720633 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 10759
I20260806 20:36:25.730633 11433 tablet_replica.cc:330] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: stopping tablet replica
I20260806 20:36:25.731129 11433 raft_consensus.cc:2229] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:25.731710 11432 tablet_replica.cc:330] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: stopping tablet replica
I20260806 20:36:25.731704 11433 raft_consensus.cc:2258] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:25.732206 11432 raft_consensus.cc:2229] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:25.732402 11435 tablet_replica.cc:330] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: stopping tablet replica
I20260806 20:36:25.732844 11432 raft_consensus.cc:2258] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:25.732930 11435 raft_consensus.cc:2229] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:36:25.733767 11435 raft_consensus.cc:2258] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:25.736071 11432 ts_tablet_manager.cc:1905] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:25.736238 11435 ts_tablet_manager.cc:1905] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:25.740147 11433 ts_tablet_manager.cc:1905] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:25.743713 11432 ts_tablet_manager.cc:1918] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:25.744059 11432 log.cc:1196] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/5ef02a0703a540138b1be994c3d210b2
I20260806 20:36:25.744146 11435 ts_tablet_manager.cc:1918] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:25.744350 11435 log.cc:1196] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/5ef02a0703a540138b1be994c3d210b2
I20260806 20:36:25.744879 11432 ts_tablet_manager.cc:1939] T 5ef02a0703a540138b1be994c3d210b2 P bb0cbc49e7c6466a8c1f1d0f5c88f43a: Deleting consensus metadata
I20260806 20:36:25.745021 11435 ts_tablet_manager.cc:1939] T 5ef02a0703a540138b1be994c3d210b2 P 0ff197d8a2ab494f9e97452a9b000549: Deleting consensus metadata
I20260806 20:36:25.746910 10648 catalog_manager.cc:4841] TS 0ff197d8a2ab494f9e97452a9b000549 (127.13.149.67:39869): tablet 5ef02a0703a540138b1be994c3d210b2 (table test-table [id=919ad5427dac4f338a230f6f1b7aaa0b]) successfully deleted
I20260806 20:36:25.747056 11433 ts_tablet_manager.cc:1918] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:25.747215 11433 log.cc:1196] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/5ef02a0703a540138b1be994c3d210b2
I20260806 20:36:25.747301 10648 catalog_manager.cc:4841] TS bb0cbc49e7c6466a8c1f1d0f5c88f43a (127.13.149.66:40573): tablet 5ef02a0703a540138b1be994c3d210b2 (table test-table [id=919ad5427dac4f338a230f6f1b7aaa0b]) successfully deleted
I20260806 20:36:25.747766 11433 ts_tablet_manager.cc:1939] T 5ef02a0703a540138b1be994c3d210b2 P c7573e8bab904a8194efc7bd7d6cc931: Deleting consensus metadata
I20260806 20:36:25.751240 10647 catalog_manager.cc:4841] TS c7573e8bab904a8194efc7bd7d6cc931 (127.13.149.65:36055): tablet 5ef02a0703a540138b1be994c3d210b2 (table test-table [id=919ad5427dac4f338a230f6f1b7aaa0b]) successfully deleted
Aug 06 20:36:25 dist-test-slave-2kcd krb5kdc[10598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:36:25.758919 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.722430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46414 (local address 127.13.149.65:36055)
0806 20:36:25.722654 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.722663 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.731627 (+ 8964us) server_negotiation.cc:407] Connection header received
0806 20:36:25.731950 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.731956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.732037 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.734127 (+ 2090us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:25.734297 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.735438 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.737413 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.738060 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.738168 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.752777 (+ 14609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:25.752831 (+ 54us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:25.752852 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:25.752909 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:25.755738 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.756678 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.756685 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.756687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.756913 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.757373 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.757376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.757378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.757712 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:25.757950 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.758382 (+ 432us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.758538 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:36:25.769364 10954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:25.882103 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 10759
I20260806 20:36:25.908572 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 10968
Aug 06 20:36:25 dist-test-slave-2kcd krb5kdc[10598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:36:25.926496 11386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:25.909496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.13.149.66:40573)
0806 20:36:25.909704 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:25.909709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:25.909730 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:36:25.909851 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:25.909856 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:25.909958 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:25.910083 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:25.911413 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.912168 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.913595 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:25.913991 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:25.914127 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:25.919071 (+ 4944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:25.919093 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:25.919119 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:25.919166 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:25.923245 (+ 4079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.924001 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.924012 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.924016 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.924181 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:25.924555 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:25.924561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:25.924564 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:25.925244 (+ 680us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:25.925593 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:25.925817 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 20:36:25.926056 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:36:25.927277 11140 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:26.019135 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 10968
I20260806 20:36:26.048400 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 11160
Aug 06 20:36:26 dist-test-slave-2kcd krb5kdc[10598](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:36:26.067984 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:26.049379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52612 (local address 127.13.149.67:39869)
0806 20:36:26.049607 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:26.049616 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:26.049643 (+ 27us) server_negotiation.cc:407] Connection header received
0806 20:36:26.049723 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:26.049729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:26.049835 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:26.049977 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:26.051284 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:26.052568 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:26.054124 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:26.054920 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:26.055069 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:26.060161 (+ 5092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:26.060181 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:26.060206 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:26.060265 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:26.064611 (+ 4346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:26.065397 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:26.065409 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:26.065413 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:26.065641 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:26.066050 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:26.066062 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:26.066067 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:26.066616 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:26.066977 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:26.067169 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 20:36:26.067466 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 20:36:26.068956 11353 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:26.191965 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 11160
I20260806 20:36:26.220414 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 10621
I20260806 20:36:26.221556 10709 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:26.334408 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 10621
2026-08-06T20:36:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4924 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T20:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:26Z Disabled control of system clock
I20260806 20:36:26.435061 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44883
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:43069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:44883
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 20:36:26.775971 11447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:26.776273 11447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:26.776358 11447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:26.783702 11447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:26.783809 11447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:26.783855 11447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:26.783921 11447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:26.783968 11447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:26.794217 11447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:44883
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:44883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:26.795534 11447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:26.797349 11447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:26.809867 11459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:26.809903 11457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:26.809875 11456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:26.810642 11447 server_base.cc:1034] running on GCE node
I20260806 20:36:26.811604 11447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:26.813475 11447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:26.814694 11447 hybrid_clock.cc:648] HybridClock initialized: now 1786048586814631 us; error 51 us; skew 500 ppm
I20260806 20:36:26.815129 11447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:26.818435 11447 webserver.cc:460] Webserver started at http://127.13.149.126:33319/ using document root <none> and password file <none>
I20260806 20:36:26.819240 11447 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:26.819339 11447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:26.819643 11447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:26.823168 11447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "84697e96e6a74377be21d22b57811df7"
format_stamp: "Formatted at 2026-08-06 20:36:26 on dist-test-slave-2kcd"
server_key: "c34ecb45c25d08eb948b62113d84fea0"
server_key_iv: "c3a17d4b29d2e8e4fbd1798f80c40744"
server_key_version: "encryptionkey@0"
I20260806 20:36:26.823976 11447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "84697e96e6a74377be21d22b57811df7"
format_stamp: "Formatted at 2026-08-06 20:36:26 on dist-test-slave-2kcd"
server_key: "c34ecb45c25d08eb948b62113d84fea0"
server_key_iv: "c3a17d4b29d2e8e4fbd1798f80c40744"
server_key_version: "encryptionkey@0"
I20260806 20:36:26.829135 11447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 20:36:26.832429 11465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:26.833742 11447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:36:26.833953 11447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "84697e96e6a74377be21d22b57811df7"
format_stamp: "Formatted at 2026-08-06 20:36:26 on dist-test-slave-2kcd"
server_key: "c34ecb45c25d08eb948b62113d84fea0"
server_key_iv: "c3a17d4b29d2e8e4fbd1798f80c40744"
server_key_version: "encryptionkey@0"
I20260806 20:36:26.834185 11447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:26.847995 11447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:26.848765 11447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:26.849086 11447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:26.867717 11447 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:44883
I20260806 20:36:26.867751 11547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:44883 every 8 connection(s)
I20260806 20:36:26.869184 11447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:26.871904 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 11447
I20260806 20:36:26.872125 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:26.872696 13909 external_mini_cluster.cc:1428] Setting key e964e16fe87722c1bea1483b17aed48a
I20260806 20:36:26.873610 11549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:26.886255 11549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7: Bootstrap starting.
I20260806 20:36:26.887184 11556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:26.874667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52152 (local address 127.13.149.126:44883)
0806 20:36:26.875651 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:26.875662 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:26.875702 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:36:26.878278 (+ 2576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:26.878317 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:26.878778 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:26.879187 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:26.879771 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:26.881177 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:26.882596 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:26.883264 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:26.883502 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:26.884695 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:26.884702 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:26.884714 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:26.885280 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:26.885362 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:26.885382 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:26.885508 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:26.885736 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 20:36:26.886183 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":367,"threads_started":1}
I20260806 20:36:26.890008 11549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:26.891007 11549 log.cc:824] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:26.893733 11549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7: No bootstrap required, opened a new log
I20260806 20:36:26.900604 11549 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84697e96e6a74377be21d22b57811df7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44883 } }
I20260806 20:36:26.901041 11549 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:26.901147 11549 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84697e96e6a74377be21d22b57811df7, State: Initialized, Role: FOLLOWER
I20260806 20:36:26.901665 11549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84697e96e6a74377be21d22b57811df7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44883 } }
I20260806 20:36:26.901909 11549 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:26.902055 11549 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:26.902230 11549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:26.904345 11549 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84697e96e6a74377be21d22b57811df7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44883 } }
I20260806 20:36:26.904908 11549 leader_election.cc:302] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84697e96e6a74377be21d22b57811df7; no voters:
I20260806 20:36:26.905459 11549 leader_election.cc:288] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:26.905611 11559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:26.906453 11559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [term 1 LEADER]: Becoming Leader. State: Replica: 84697e96e6a74377be21d22b57811df7, State: Running, Role: LEADER
I20260806 20:36:26.906988 11559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84697e96e6a74377be21d22b57811df7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44883 } }
I20260806 20:36:26.907562 11549 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:26.909742 11562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84697e96e6a74377be21d22b57811df7. Latest consensus state: current_term: 1 leader_uuid: "84697e96e6a74377be21d22b57811df7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84697e96e6a74377be21d22b57811df7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44883 } } }
I20260806 20:36:26.910207 11562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:26.911566 11560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84697e96e6a74377be21d22b57811df7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84697e96e6a74377be21d22b57811df7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 44883 } } }
I20260806 20:36:26.911876 11560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:26.913017 11569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:26.918401 11569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:26.927392 11569 catalog_manager.cc:1347] Generated new cluster ID: 9591b57c24664551ae64d374b4b8a6d4
I20260806 20:36:26.927546 11569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:26.949572 11569 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:26.950884 11569 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:26.959758 11569 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7: Generated new TSK 0
I20260806 20:36:26.960561 11569 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:26.965281 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44883
--builtin_ntp_servers=127.13.149.84:43069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 20:36:27.335592 11583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:27.335853 11583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:27.335948 11583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:27.343148 11583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:27.343242 11583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:27.343346 11583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:36:27.352021 11583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:27.353412 11583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:27.355094 11583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:27.367871 11596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:27.367913 11592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:27.368006 11594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:27.368919 11583 server_base.cc:1034] running on GCE node
I20260806 20:36:27.369503 11583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:27.370347 11583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:27.371560 11583 hybrid_clock.cc:648] HybridClock initialized: now 1786048587371524 us; error 26 us; skew 500 ppm
I20260806 20:36:27.371874 11583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:27.374049 11583 webserver.cc:460] Webserver started at http://127.13.149.65:34861/ using document root <none> and password file <none>
I20260806 20:36:27.374694 11583 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:27.374847 11583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:27.375162 11583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:27.377993 11583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "1f93e78463ad4c94845d0abdf9f5c2ed"
format_stamp: "Formatted at 2026-08-06 20:36:27 on dist-test-slave-2kcd"
server_key: "11083853b3bc85c975dbd64e9a589fe8"
server_key_iv: "b34861908ee42133553c4ef0a7577447"
server_key_version: "encryptionkey@0"
I20260806 20:36:27.378786 11583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "1f93e78463ad4c94845d0abdf9f5c2ed"
format_stamp: "Formatted at 2026-08-06 20:36:27 on dist-test-slave-2kcd"
server_key: "11083853b3bc85c975dbd64e9a589fe8"
server_key_iv: "b34861908ee42133553c4ef0a7577447"
server_key_version: "encryptionkey@0"
I20260806 20:36:27.383605 11583 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 20:36:27.387279 11603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:27.388763 11583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 20:36:27.388988 11583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "1f93e78463ad4c94845d0abdf9f5c2ed"
format_stamp: "Formatted at 2026-08-06 20:36:27 on dist-test-slave-2kcd"
server_key: "11083853b3bc85c975dbd64e9a589fe8"
server_key_iv: "b34861908ee42133553c4ef0a7577447"
server_key_version: "encryptionkey@0"
I20260806 20:36:27.389197 11583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:27.419761 11583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:27.420708 11583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:27.421067 11583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:27.422102 11583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:27.423723 11583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:27.423848 11583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:27.423993 11583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:27.424098 11583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:27.458240 11583 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:35885
I20260806 20:36:27.458338 11769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:35885 every 8 connection(s)
I20260806 20:36:27.459729 11583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:36:27.463812 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 11583
I20260806 20:36:27.464007 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:36:27.464545 13909 external_mini_cluster.cc:1428] Setting key 3b2212799996afe35ff1fc64b072b5c2
I20260806 20:36:27.467586 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44883
--builtin_ntp_servers=127.13.149.84:43069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 20:36:27.474859 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:27.462444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:50919 (local address 127.13.149.126:44883)
0806 20:36:27.462868 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:27.462873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:27.464216 (+ 1343us) server_negotiation.cc:407] Connection header received
0806 20:36:27.466560 (+ 2344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:27.466564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:27.466628 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:27.466759 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:27.467869 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.468579 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.471106 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.471537 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.471640 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:27.473435 (+ 1795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:27.473444 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:27.473451 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:27.473494 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:27.473560 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:27.473582 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:27.473690 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:27.474183 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 20:36:27.474336 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":223,"threads_started":1}
I20260806 20:36:27.476029 11778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:27.463067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44883 (local address 127.13.149.65:50919)
0806 20:36:27.464026 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:27.464086 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:27.466228 (+ 2142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:27.466968 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:27.466976 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:27.467060 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:27.467628 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:27.467644 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.468745 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.468753 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:27.470933 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:27.470951 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.471790 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.471800 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:27.472150 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:27.472990 (+ 840us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:27.472996 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:27.473049 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:27.473146 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:27.473727 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:27.473741 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:27.473797 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 20:36:27.474062 (+ 265us) client_negotiation.cc:240] Negotiation successful
0806 20:36:27.474469 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":302,"threads_started":1}
I20260806 20:36:27.477762 11770 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44883
I20260806 20:36:27.478102 11770 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:27.478863 11770 heartbeater.cc:511] Master 127.13.149.126:44883 requested a full tablet report, sending...
I20260806 20:36:27.481011 11487 ts_manager.cc:194] Registered new tserver with Master: 1f93e78463ad4c94845d0abdf9f5c2ed (127.13.149.65:35885)
I20260806 20:36:27.483016 11487 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.65:50919
W20260806 20:36:27.814085 11780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:27.814417 11780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:27.814563 11780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:27.821823 11780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:27.821913 11780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:27.822093 11780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:36:27.831140 11780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:27.832417 11780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:27.834257 11780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:27.847997 11788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:27.847913 11791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:27.847972 11789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:27.849697 11780 server_base.cc:1034] running on GCE node
I20260806 20:36:27.850394 11780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:27.851359 11780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:27.852566 11780 hybrid_clock.cc:648] HybridClock initialized: now 1786048587852500 us; error 62 us; skew 500 ppm
I20260806 20:36:27.852944 11780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:27.855253 11780 webserver.cc:460] Webserver started at http://127.13.149.66:40483/ using document root <none> and password file <none>
I20260806 20:36:27.855958 11780 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:27.856048 11780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:27.856418 11780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:27.859364 11780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "ff884196ded54baf8e827892ce5f67b9"
format_stamp: "Formatted at 2026-08-06 20:36:27 on dist-test-slave-2kcd"
server_key: "64958541e9b485373fc74c7e97673b0b"
server_key_iv: "09856f0a2d2c2816cfa8c1c9f3a09858"
server_key_version: "encryptionkey@0"
I20260806 20:36:27.860162 11780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "ff884196ded54baf8e827892ce5f67b9"
format_stamp: "Formatted at 2026-08-06 20:36:27 on dist-test-slave-2kcd"
server_key: "64958541e9b485373fc74c7e97673b0b"
server_key_iv: "09856f0a2d2c2816cfa8c1c9f3a09858"
server_key_version: "encryptionkey@0"
I20260806 20:36:27.865746 11780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260806 20:36:27.869366 11801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:27.870755 11780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:36:27.870935 11780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "ff884196ded54baf8e827892ce5f67b9"
format_stamp: "Formatted at 2026-08-06 20:36:27 on dist-test-slave-2kcd"
server_key: "64958541e9b485373fc74c7e97673b0b"
server_key_iv: "09856f0a2d2c2816cfa8c1c9f3a09858"
server_key_version: "encryptionkey@0"
I20260806 20:36:27.871155 11780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:27.913587 11780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:27.914609 11780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:27.914943 11780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:27.915987 11780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:27.917563 11780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:27.917694 11780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:27.917827 11780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:27.917927 11780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:27.952319 11780 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:44739
I20260806 20:36:27.952379 11958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:44739 every 8 connection(s)
I20260806 20:36:27.953758 11780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:36:27.962469 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 11780
I20260806 20:36:27.962656 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:36:27.963208 13909 external_mini_cluster.cc:1428] Setting key 4ebfaf6bc39eaf1d15ed6654bd4d1121
I20260806 20:36:27.966253 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44883
--builtin_ntp_servers=127.13.149.84:43069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 20:36:27.967331 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:27.956397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:37329 (local address 127.13.149.126:44883)
0806 20:36:27.956611 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:27.956617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:27.958034 (+ 1417us) server_negotiation.cc:407] Connection header received
0806 20:36:27.959738 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:27.959742 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:27.959832 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:27.959927 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:27.961114 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.961921 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.964183 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.964771 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.964921 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:27.966387 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:27.966396 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:27.966403 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:27.966429 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:27.966475 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:27.966495 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:27.966593 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:27.966814 (+ 221us) server_negotiation.cc:299] Negotiation successful
0806 20:36:27.966932 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:36:27.968312 11964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:27.956975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44883 (local address 127.13.149.66:37329)
0806 20:36:27.957858 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:27.957911 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:27.959501 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:27.960220 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:27.960228 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:27.960312 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:27.960961 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:27.960979 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.962107 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.962113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:27.963990 (+ 1877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:27.964003 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:27.965009 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:27.965014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:27.965317 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:27.966044 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:27.966047 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:27.966085 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:27.966159 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:27.966606 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:27.966615 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:27.966621 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 20:36:27.966769 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 20:36:27.967148 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":267,"threads_started":1}
I20260806 20:36:27.969776 11960 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44883
I20260806 20:36:27.970114 11960 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:27.971062 11960 heartbeater.cc:511] Master 127.13.149.126:44883 requested a full tablet report, sending...
I20260806 20:36:27.972610 11487 ts_manager.cc:194] Registered new tserver with Master: ff884196ded54baf8e827892ce5f67b9 (127.13.149.66:44739)
I20260806 20:36:27.973502 11487 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.66:37329
W20260806 20:36:28.308635 11965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:28.308966 11965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:28.309132 11965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:28.316457 11965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:28.316543 11965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:28.316711 11965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:36:28.325588 11965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:44883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:28.326900 11965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:28.328734 11965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:28.342151 11975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:28.342236 11980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:28.342196 11974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:28.343097 11965 server_base.cc:1034] running on GCE node
I20260806 20:36:28.343643 11965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:28.344522 11965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:28.345731 11965 hybrid_clock.cc:648] HybridClock initialized: now 1786048588345662 us; error 61 us; skew 500 ppm
I20260806 20:36:28.346081 11965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:28.348402 11965 webserver.cc:460] Webserver started at http://127.13.149.67:46619/ using document root <none> and password file <none>
I20260806 20:36:28.349203 11965 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:28.349323 11965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:28.349654 11965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:28.352492 11965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "ba3f4bf248af467badb1b65fba2ed21f"
format_stamp: "Formatted at 2026-08-06 20:36:28 on dist-test-slave-2kcd"
server_key: "f176e00f75d22d2ea900f4055a31b5dd"
server_key_iv: "929e6b07881b03032a1a418b413752fc"
server_key_version: "encryptionkey@0"
I20260806 20:36:28.353382 11965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "ba3f4bf248af467badb1b65fba2ed21f"
format_stamp: "Formatted at 2026-08-06 20:36:28 on dist-test-slave-2kcd"
server_key: "f176e00f75d22d2ea900f4055a31b5dd"
server_key_iv: "929e6b07881b03032a1a418b413752fc"
server_key_version: "encryptionkey@0"
I20260806 20:36:28.358520 11965 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:36:28.362216 11991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:28.363555 11965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 20:36:28.363720 11965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "ba3f4bf248af467badb1b65fba2ed21f"
format_stamp: "Formatted at 2026-08-06 20:36:28 on dist-test-slave-2kcd"
server_key: "f176e00f75d22d2ea900f4055a31b5dd"
server_key_iv: "929e6b07881b03032a1a418b413752fc"
server_key_version: "encryptionkey@0"
I20260806 20:36:28.363938 11965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:28.381268 11965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:28.382097 11965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:28.382411 11965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:28.383375 11965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:28.384927 11965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:28.385027 11965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:28.385174 11965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:28.385269 11965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:28.421676 11965 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:45149
I20260806 20:36:28.421741 12155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:45149 every 8 connection(s)
I20260806 20:36:28.423041 11965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:36:28.430128 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 11965
I20260806 20:36:28.430320 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:36:28.430891 13909 external_mini_cluster.cc:1428] Setting key db5cca255ff80704832ade2f701b9ff7
I20260806 20:36:28.436400 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.425769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:44291 (local address 127.13.149.126:44883)
0806 20:36:28.425966 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.425970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.427318 (+ 1348us) server_negotiation.cc:407] Connection header received
0806 20:36:28.429109 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.429114 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.429201 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.429304 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:28.430376 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.431466 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.433762 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.434261 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.434361 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.435703 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:28.435708 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:28.435711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:28.435728 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:28.435759 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:28.435770 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:28.435842 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.436059 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.436150 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:36:28.437470 12162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.426270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:44883 (local address 127.13.149.67:44291)
0806 20:36:28.427161 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:28.427204 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:28.428776 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:28.429499 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:28.429509 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:28.429588 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:28.430145 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.430162 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.431648 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.431655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.433606 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.433623 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.434471 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.434476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.434681 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.435407 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:28.435410 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:28.435448 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:28.435528 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:28.435859 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:28.435867 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:28.435873 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 20:36:28.436009 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 20:36:28.436301 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":278,"threads_started":1}
I20260806 20:36:28.438850 12158 heartbeater.cc:347] Connected to a master server at 127.13.149.126:44883
I20260806 20:36:28.439175 12158 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:28.439903 12158 heartbeater.cc:511] Master 127.13.149.126:44883 requested a full tablet report, sending...
I20260806 20:36:28.441329 11487 ts_manager.cc:194] Registered new tserver with Master: ba3f4bf248af467badb1b65fba2ed21f (127.13.149.67:45149)
I20260806 20:36:28.442114 11487 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.67:44291
I20260806 20:36:28.446234 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:36:28.461984 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.450505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52164 (local address 127.13.149.126:44883)
0806 20:36:28.450661 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.450666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.451148 (+ 482us) server_negotiation.cc:407] Connection header received
0806 20:36:28.451340 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.451346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.451432 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.451538 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:28.452054 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.452736 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.454121 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.454572 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.454711 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.461115 (+ 6404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:28.461120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:28.461123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:28.461139 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:28.461171 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:28.461182 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:28.461302 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.461507 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.461583 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 20:36:28.465548 11487 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:36:28.472345 11487 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:36:28.486094 11770 heartbeater.cc:503] Master 127.13.149.126:44883 was elected leader, sending a full tablet report...
I20260806 20:36:28.503551 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.485726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:45149 (local address 127.0.0.1:57006)
0806 20:36:28.495132 (+ 9406us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:28.495145 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:28.495280 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:28.496020 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:28.496028 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:28.496064 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:28.496634 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.496653 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.499084 (+ 2431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.499090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.501115 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.501128 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.502545 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.502553 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.502787 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.502857 (+ 70us) client_negotiation.cc:769] Sending connection context
0806 20:36:28.502963 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 20:36:28.503167 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9309,"mutex_wait_us":109,"thread_start_us":9209,"threads_started":1}
I20260806 20:36:28.504988 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.485215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35885 (local address 127.0.0.1:39848)
0806 20:36:28.494485 (+ 9270us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:28.494524 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:28.494697 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:28.496447 (+ 1750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:28.496454 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:28.496488 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:28.496962 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.496975 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.499503 (+ 2528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.499514 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.502257 (+ 2743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.502269 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.504145 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.504152 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.504328 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.504362 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 20:36:28.504455 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 20:36:28.504599 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9001,"mutex_wait_us":179,"thread_start_us":10721,"threads_started":1}
I20260806 20:36:28.504990 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.486750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57006 (local address 127.13.149.67:45149)
0806 20:36:28.487371 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.487380 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.495257 (+ 7877us) server_negotiation.cc:407] Connection header received
0806 20:36:28.495426 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.495439 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.495727 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.496941 (+ 1214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:28.497234 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.498927 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.501305 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.502300 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.504072 (+ 1772us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.504349 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.504453 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.504625 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":665,"threads_started":1}
I20260806 20:36:28.505164 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.485533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39848 (local address 127.13.149.65:35885)
0806 20:36:28.495836 (+ 10303us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.495845 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.495875 (+ 30us) server_negotiation.cc:407] Connection header received
0806 20:36:28.495970 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.495977 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.496198 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.497697 (+ 1499us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:28.497929 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.499354 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.502479 (+ 3125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.503944 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.504086 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.504353 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.504546 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.504730 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10110,"thread_start_us":9977,"threads_started":1}
I20260806 20:36:28.505548 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.487192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35676 (local address 127.13.149.66:44739)
0806 20:36:28.492403 (+ 5211us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.492416 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.496361 (+ 3945us) server_negotiation.cc:407] Connection header received
0806 20:36:28.496697 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.496705 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.496949 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.497115 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:28.498158 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.499206 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.502479 (+ 3273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.503942 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.504062 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.504323 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.504976 (+ 653us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.505150 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5013,"thread_start_us":4883,"threads_started":1}
I20260806 20:36:28.506255 12175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.485983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:44739 (local address 127.0.0.1:35676)
0806 20:36:28.496229 (+ 10246us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:28.496249 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:28.496485 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:28.497475 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:28.497480 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:28.497509 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:28.497943 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.497957 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.499380 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.499384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.502225 (+ 2841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.502246 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.504558 (+ 2312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.504565 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.504744 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.504775 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 20:36:28.505814 (+ 1039us) client_negotiation.cc:240] Negotiation successful
0806 20:36:28.505940 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10114,"mutex_wait_us":214,"thread_start_us":8061,"threads_started":1}
I20260806 20:36:28.509212 11680 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa93603beec45fa965fb290400f079b (DEFAULT_TABLE table=test-table [id=63ee295d8b884275a67ebbc01335c114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:28.509294 12050 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa93603beec45fa965fb290400f079b (DEFAULT_TABLE table=test-table [id=63ee295d8b884275a67ebbc01335c114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:28.510576 11680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa93603beec45fa965fb290400f079b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:28.510104 11872 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa93603beec45fa965fb290400f079b (DEFAULT_TABLE table=test-table [id=63ee295d8b884275a67ebbc01335c114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:28.510841 12050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa93603beec45fa965fb290400f079b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:28.511411 11872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa93603beec45fa965fb290400f079b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:28.522133 12182 tablet_bootstrap.cc:492] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Bootstrap starting.
I20260806 20:36:28.526299 12182 tablet_bootstrap.cc:654] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:28.526499 12186 tablet_bootstrap.cc:492] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Bootstrap starting.
I20260806 20:36:28.528111 12182 log.cc:824] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:28.530256 12186 tablet_bootstrap.cc:654] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:28.531462 12186 log.cc:824] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:28.531551 12182 tablet_bootstrap.cc:492] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: No bootstrap required, opened a new log
I20260806 20:36:28.531806 12182 ts_tablet_manager.cc:1397] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 20:36:28.535028 12183 tablet_bootstrap.cc:492] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Bootstrap starting.
I20260806 20:36:28.539179 12186 tablet_bootstrap.cc:492] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: No bootstrap required, opened a new log
I20260806 20:36:28.539361 12183 tablet_bootstrap.cc:654] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:28.539500 12186 ts_tablet_manager.cc:1397] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260806 20:36:28.540704 12183 log.cc:824] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:28.541505 12182 raft_consensus.cc:348] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.541993 12182 raft_consensus.cc:374] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:28.542107 12182 raft_consensus.cc:729] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f93e78463ad4c94845d0abdf9f5c2ed, State: Initialized, Role: FOLLOWER
I20260806 20:36:28.542737 12182 consensus_queue.cc:260] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.543932 12183 tablet_bootstrap.cc:492] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: No bootstrap required, opened a new log
I20260806 20:36:28.544260 12183 ts_tablet_manager.cc:1397] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.004s
I20260806 20:36:28.544433 12182 ts_tablet_manager.cc:1428] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Time spent starting tablet: real 0.012s user 0.014s sys 0.000s
I20260806 20:36:28.550990 12186 raft_consensus.cc:348] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.551460 12186 raft_consensus.cc:374] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:28.551578 12186 raft_consensus.cc:729] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff884196ded54baf8e827892ce5f67b9, State: Initialized, Role: FOLLOWER
I20260806 20:36:28.552228 12186 consensus_queue.cc:260] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.553363 11960 heartbeater.cc:503] Master 127.13.149.126:44883 was elected leader, sending a full tablet report...
I20260806 20:36:28.554148 12186 ts_tablet_manager.cc:1428] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260806 20:36:28.555508 12183 raft_consensus.cc:348] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.556012 12183 raft_consensus.cc:374] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:28.556146 12183 raft_consensus.cc:729] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3f4bf248af467badb1b65fba2ed21f, State: Initialized, Role: FOLLOWER
I20260806 20:36:28.556838 12183 consensus_queue.cc:260] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.557991 12158 heartbeater.cc:503] Master 127.13.149.126:44883 was elected leader, sending a full tablet report...
I20260806 20:36:28.558560 12183 ts_tablet_manager.cc:1428] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260806 20:36:28.665490 12194 raft_consensus.cc:482] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:36:28.665865 12194 raft_consensus.cc:504] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.667806 12194 leader_election.cc:288] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f93e78463ad4c94845d0abdf9f5c2ed (127.13.149.65:35885), ff884196ded54baf8e827892ce5f67b9 (127.13.149.66:44739)
W20260806 20:36:28.674784 12160 tablet.cc:2369] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:28.675535 12162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.668394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:44739 (local address 127.13.149.67:45847)
0806 20:36:28.668816 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:28.668836 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:28.669013 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:28.669390 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:28.669394 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:28.669422 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:28.669661 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.669669 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.671009 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.671013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.673093 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.673108 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.674702 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.674708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.674909 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.674942 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 20:36:28.675047 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 20:36:28.675193 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"spinlock_wait_cycles":37248}
I20260806 20:36:28.675536 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.668484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:45847 (local address 127.13.149.66:44739)
0806 20:36:28.668731 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.668737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.668933 (+ 196us) server_negotiation.cc:407] Connection header received
0806 20:36:28.669163 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.669175 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.669248 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.669357 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:28.669902 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.670882 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.673255 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.674516 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.674684 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.674763 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.675135 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.675263 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260806 20:36:28.675741 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.668257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:36029 (local address 127.13.149.65:35885)
0806 20:36:28.668476 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.668482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.669443 (+ 961us) server_negotiation.cc:407] Connection header received
0806 20:36:28.669704 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.669708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.669821 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.669918 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:28.670430 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.671284 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.673523 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.674798 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.674982 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.675044 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.675388 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.675511 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 20:36:28.676424 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.668510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:35885 (local address 127.13.149.67:36029)
0806 20:36:28.669324 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:28.669338 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:28.669521 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:28.669933 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:28.669936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:28.669954 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:28.670267 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.670274 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.671425 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.671430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.673357 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:28.673367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.674990 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.674996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:28.675188 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.675220 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 20:36:28.676017 (+ 797us) client_negotiation.cc:240] Negotiation successful
0806 20:36:28.676180 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":493,"threads_started":1}
I20260806 20:36:28.676746 11903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa93603beec45fa965fb290400f079b" candidate_uuid: "ba3f4bf248af467badb1b65fba2ed21f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff884196ded54baf8e827892ce5f67b9" is_pre_election: true
I20260806 20:36:28.677397 11903 raft_consensus.cc:2454] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3f4bf248af467badb1b65fba2ed21f in term 0.
I20260806 20:36:28.677531 11707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa93603beec45fa965fb290400f079b" candidate_uuid: "ba3f4bf248af467badb1b65fba2ed21f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" is_pre_election: true
I20260806 20:36:28.678061 11707 raft_consensus.cc:2454] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3f4bf248af467badb1b65fba2ed21f in term 0.
I20260806 20:36:28.678175 11993 leader_election.cc:302] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3f4bf248af467badb1b65fba2ed21f, ff884196ded54baf8e827892ce5f67b9; no voters:
I20260806 20:36:28.678687 12194 raft_consensus.cc:2781] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:36:28.678895 12194 raft_consensus.cc:482] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:36:28.679016 12194 raft_consensus.cc:3037] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:28.681341 12194 raft_consensus.cc:504] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.681998 12194 leader_election.cc:288] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [CANDIDATE]: Term 1 election: Requested vote from peers 1f93e78463ad4c94845d0abdf9f5c2ed (127.13.149.65:35885), ff884196ded54baf8e827892ce5f67b9 (127.13.149.66:44739)
I20260806 20:36:28.682482 11707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa93603beec45fa965fb290400f079b" candidate_uuid: "ba3f4bf248af467badb1b65fba2ed21f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed"
I20260806 20:36:28.682561 11903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa93603beec45fa965fb290400f079b" candidate_uuid: "ba3f4bf248af467badb1b65fba2ed21f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff884196ded54baf8e827892ce5f67b9"
I20260806 20:36:28.682706 11707 raft_consensus.cc:3037] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:28.682753 11903 raft_consensus.cc:3037] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:28.686081 11903 raft_consensus.cc:2454] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3f4bf248af467badb1b65fba2ed21f in term 1.
I20260806 20:36:28.686074 11707 raft_consensus.cc:2454] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3f4bf248af467badb1b65fba2ed21f in term 1.
I20260806 20:36:28.686566 11992 leader_election.cc:302] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1f93e78463ad4c94845d0abdf9f5c2ed, ba3f4bf248af467badb1b65fba2ed21f, ff884196ded54baf8e827892ce5f67b9; no voters:
I20260806 20:36:28.686898 12194 raft_consensus.cc:2781] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:28.687363 12194 raft_consensus.cc:686] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 1 LEADER]: Becoming Leader. State: Replica: ba3f4bf248af467badb1b65fba2ed21f, State: Running, Role: LEADER
I20260806 20:36:28.687944 12194 consensus_queue.cc:237] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } }
I20260806 20:36:28.692665 11487 catalog_manager.cc:5495] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f reported cstate change: term changed from 0 to 1, leader changed from <none> to ba3f4bf248af467badb1b65fba2ed21f (127.13.149.67). New cstate: current_term: 1 leader_uuid: "ba3f4bf248af467badb1b65fba2ed21f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3f4bf248af467badb1b65fba2ed21f" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 } health_report { overall_health: UNKNOWN } } }
W20260806 20:36:28.705904 11961 tablet.cc:2369] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:28.712282 11773 tablet.cc:2369] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:28.736135 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.730424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.13.149.67:45149)
0806 20:36:28.730654 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.730661 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.730766 (+ 105us) server_negotiation.cc:407] Connection header received
0806 20:36:28.731017 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.731022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.731107 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.731255 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:36:28.731626 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.732391 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.733883 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.734302 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.734440 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.735051 (+ 611us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:36:28.735525 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:36:28.735711 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.735873 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.735920 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 20:36:28.744117 11903 raft_consensus.cc:1261] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 1 FOLLOWER]: Refusing update from remote peer ba3f4bf248af467badb1b65fba2ed21f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:28.744172 11707 raft_consensus.cc:1261] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 1 FOLLOWER]: Refusing update from remote peer ba3f4bf248af467badb1b65fba2ed21f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:28.745113 12196 consensus_queue.cc:1035] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f93e78463ad4c94845d0abdf9f5c2ed" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 35885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:28.745446 12194 consensus_queue.cc:1035] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff884196ded54baf8e827892ce5f67b9" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:28.757102 12200 mvcc.cc:205] Tried to move back new op lower bound from 7315655019486470144 to 7315655019270152192. Current Snapshot: MvccSnapshot[applied={T|T < 7315655019486470144}]
I20260806 20:36:28.770977 11486 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:28.771274 11486 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:28.775460 11486 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 84697e96e6a74377be21d22b57811df7: Sending DeleteTablet for 3 replicas of tablet 3aa93603beec45fa965fb290400f079b
I20260806 20:36:28.776734 12050 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa93603beec45fa965fb290400f079b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:28 UTC) from {username='slave'} at 127.0.0.1:57006
I20260806 20:36:28.776767 11872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa93603beec45fa965fb290400f079b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:28 UTC) from {username='slave'} at 127.0.0.1:35676
I20260806 20:36:28.777626 11680 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa93603beec45fa965fb290400f079b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:28 UTC) from {username='slave'} at 127.0.0.1:39848
I20260806 20:36:28.778263 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 11583
I20260806 20:36:28.791224 12215 tablet_replica.cc:330] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: stopping tablet replica
I20260806 20:36:28.792265 12215 raft_consensus.cc:2229] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:28.793258 12215 raft_consensus.cc:2258] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:28.795804 12215 ts_tablet_manager.cc:1905] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:28.802009 12213 tablet_replica.cc:330] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: stopping tablet replica
I20260806 20:36:28.802899 12213 raft_consensus.cc:2229] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:36:28.803444 12215 ts_tablet_manager.cc:1918] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:28.803699 12215 log.cc:1196] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/3aa93603beec45fa965fb290400f079b
I20260806 20:36:28.804021 12213 raft_consensus.cc:2258] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:28.804368 12215 ts_tablet_manager.cc:1939] T 3aa93603beec45fa965fb290400f079b P 1f93e78463ad4c94845d0abdf9f5c2ed: Deleting consensus metadata
I20260806 20:36:28.806505 11466 catalog_manager.cc:4841] TS 1f93e78463ad4c94845d0abdf9f5c2ed (127.13.149.65:35885): tablet 3aa93603beec45fa965fb290400f079b (table test-table [id=63ee295d8b884275a67ebbc01335c114]) successfully deleted
I20260806 20:36:28.810410 12213 ts_tablet_manager.cc:1905] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:28.810730 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.779517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39858 (local address 127.13.149.65:35885)
0806 20:36:28.779688 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.779694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.793199 (+ 13505us) server_negotiation.cc:407] Connection header received
0806 20:36:28.794144 (+ 945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.794154 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.794341 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.794458 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:28.796029 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.797733 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.804426 (+ 6693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.805534 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.805693 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.809025 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:28.809036 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:28.809054 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:28.809789 (+ 735us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:28.809846 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:28.809872 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:28.809969 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.810234 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.810349 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:36:28.811949 11763 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:28.812181 12212 tablet_replica.cc:330] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: stopping tablet replica
I20260806 20:36:28.812680 12212 raft_consensus.cc:2229] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:28.813282 12212 raft_consensus.cc:2258] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:28.815346 12212 ts_tablet_manager.cc:1905] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:28.822381 12212 ts_tablet_manager.cc:1918] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:28.822643 12212 log.cc:1196] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/3aa93603beec45fa965fb290400f079b
I20260806 20:36:28.823323 12212 ts_tablet_manager.cc:1939] T 3aa93603beec45fa965fb290400f079b P ff884196ded54baf8e827892ce5f67b9: Deleting consensus metadata
I20260806 20:36:28.823750 12213 ts_tablet_manager.cc:1918] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:28.824256 12213 log.cc:1196] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/3aa93603beec45fa965fb290400f079b
I20260806 20:36:28.825268 12213 ts_tablet_manager.cc:1939] T 3aa93603beec45fa965fb290400f079b P ba3f4bf248af467badb1b65fba2ed21f: Deleting consensus metadata
I20260806 20:36:28.825314 11468 catalog_manager.cc:4841] TS ff884196ded54baf8e827892ce5f67b9 (127.13.149.66:44739): tablet 3aa93603beec45fa965fb290400f079b (table test-table [id=63ee295d8b884275a67ebbc01335c114]) successfully deleted
I20260806 20:36:28.827771 11470 catalog_manager.cc:4841] TS ba3f4bf248af467badb1b65fba2ed21f (127.13.149.67:45149): tablet 3aa93603beec45fa965fb290400f079b (table test-table [id=63ee295d8b884275a67ebbc01335c114]) successfully deleted
I20260806 20:36:28.937585 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 11583
I20260806 20:36:28.974275 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 11780
I20260806 20:36:28.982203 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:28.975344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35678 (local address 127.13.149.66:44739)
0806 20:36:28.975537 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:28.975544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:28.975568 (+ 24us) server_negotiation.cc:407] Connection header received
0806 20:36:28.975692 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:28.975698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:28.975810 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:28.975916 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:28.976301 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.977508 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.978830 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:28.979445 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:28.979582 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:28.980613 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:28.980624 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:28.980641 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:28.981412 (+ 771us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:28.981490 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:28.981516 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:28.981628 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:28.981744 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 20:36:28.981849 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:36:28.983002 11952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:29.073426 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 11780
I20260806 20:36:29.098650 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 11965
I20260806 20:36:29.106983 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:29.099711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57016 (local address 127.13.149.67:45149)
0806 20:36:29.099915 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:29.099923 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:29.099965 (+ 42us) server_negotiation.cc:407] Connection header received
0806 20:36:29.100039 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:29.100045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:29.100148 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:29.100270 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:29.100641 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:29.101897 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:29.103134 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:29.103832 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:29.103972 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:29.105207 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:29.105220 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:29.105242 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:29.106124 (+ 882us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:29.106187 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:29.106215 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:29.106352 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:29.106451 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 20:36:29.106575 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:36:29.107779 12148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:29.232424 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 11965
I20260806 20:36:29.259254 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 11447
I20260806 20:36:29.260481 11540 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:29.371732 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 11447
2026-08-06T20:36:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3034 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:29 dist-test-slave-2kcd krb5kdc[12227](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:29 dist-test-slave-2kcd krb5kdc[12227](info): set up 2 sockets
Aug 06 20:36:29 dist-test-slave-2kcd krb5kdc[12227](info): commencing operation
krb5kdc: starting...
W20260806 20:36:30.714769 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:30 dist-test-slave-2kcd krb5kdc[12227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:36:31.011713 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42229
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:31.355859 12247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:31.356140 12247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:31.356287 12247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:31.363277 12247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:31.363372 12247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:31.363466 12247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:31.363561 12247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:31.363637 12247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:31.372661 12247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:31.373878 12247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:31.375172 12247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:31.386902 12257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:31.387085 12255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:31.387156 12253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:31.387681 12247 server_base.cc:1034] running on GCE node
I20260806 20:36:31.388491 12247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:31.390000 12247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:31.391247 12247 hybrid_clock.cc:648] HybridClock initialized: now 1786048591391204 us; error 50 us; skew 500 ppm
I20260806 20:36:31.391604 12247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:31 dist-test-slave-2kcd krb5kdc[12227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048591, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:31.394784 12247 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:36:31.396350 12247 webserver.cc:460] Webserver started at http://127.13.149.126:46065/ using document root <none> and password file <none>
I20260806 20:36:31.397119 12247 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:31.397264 12247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:31.397568 12247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:31.400485 12247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3"
format_stamp: "Formatted at 2026-08-06 20:36:31 on dist-test-slave-2kcd"
server_key: "bdbb94d2cfc6636e239e1f5e49e70a84"
server_key_iv: "74ad0ae07b7ff7bbfeba8cf22cf89f3a"
server_key_version: "encryptionkey@0"
I20260806 20:36:31.401268 12247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3"
format_stamp: "Formatted at 2026-08-06 20:36:31 on dist-test-slave-2kcd"
server_key: "bdbb94d2cfc6636e239e1f5e49e70a84"
server_key_iv: "74ad0ae07b7ff7bbfeba8cf22cf89f3a"
server_key_version: "encryptionkey@0"
I20260806 20:36:31.406349 12247 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:36:31.409739 12267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:31.410962 12247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:36:31.411176 12247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3"
format_stamp: "Formatted at 2026-08-06 20:36:31 on dist-test-slave-2kcd"
server_key: "bdbb94d2cfc6636e239e1f5e49e70a84"
server_key_iv: "74ad0ae07b7ff7bbfeba8cf22cf89f3a"
server_key_version: "encryptionkey@0"
I20260806 20:36:31.411379 12247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:31.422194 12247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:31.426148 12247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:31.426436 12247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:31.445792 12247 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:42229
I20260806 20:36:31.445828 12343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:42229 every 8 connection(s)
I20260806 20:36:31.447247 12247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:31.451033 12344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:31.452338 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 12247
I20260806 20:36:31.452559 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:31.453262 13909 external_mini_cluster.cc:1428] Setting key 9791bef8e5ec494409b4357463cd20ae
I20260806 20:36:31.466063 12344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3: Bootstrap starting.
Aug 06 20:36:31 dist-test-slave-2kcd krb5kdc[12227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:31.469914 12344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:31.471010 12344 log.cc:824] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:31.474174 12344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3: No bootstrap required, opened a new log
I20260806 20:36:31.477775 12348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:31.455213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60380 (local address 127.13.149.126:42229)
0806 20:36:31.456007 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:31.456019 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:31.456065 (+ 46us) server_negotiation.cc:407] Connection header received
0806 20:36:31.457772 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:31.457795 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:31.458189 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:31.458512 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:31.460395 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:31.461809 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:31.463952 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:31.464627 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:31.464758 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:31.469964 (+ 5206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:31.469991 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:31.470014 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:31.470081 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:31.473584 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:31.474293 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:31.474309 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:31.474315 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:31.474502 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:31.474893 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:31.474899 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:31.474903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:31.475422 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:31.475757 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:31.476266 (+ 509us) server_negotiation.cc:299] Negotiation successful
0806 20:36:31.476695 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":365,"threads_started":1}
I20260806 20:36:31.482844 12344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42229 } }
I20260806 20:36:31.483228 12344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:31.483342 12344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e70e29ce2a24a7f9b1b885bfbb120e3, State: Initialized, Role: FOLLOWER
I20260806 20:36:31.483949 12344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42229 } }
I20260806 20:36:31.484257 12344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:31.484423 12344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:31.484601 12344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:31.487313 12344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42229 } }
I20260806 20:36:31.487833 12344 leader_election.cc:302] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e70e29ce2a24a7f9b1b885bfbb120e3; no voters:
I20260806 20:36:31.488432 12344 leader_election.cc:288] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:31.488598 12350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:31.489919 12350 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [term 1 LEADER]: Becoming Leader. State: Replica: 9e70e29ce2a24a7f9b1b885bfbb120e3, State: Running, Role: LEADER
I20260806 20:36:31.490531 12350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42229 } }
I20260806 20:36:31.490868 12344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:31.494889 12352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e70e29ce2a24a7f9b1b885bfbb120e3. Latest consensus state: current_term: 1 leader_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42229 } } }
I20260806 20:36:31.495411 12352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:31.495230 12351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e70e29ce2a24a7f9b1b885bfbb120e3" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42229 } } }
I20260806 20:36:31.495560 12351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:31.497547 12359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:31.502468 12359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:31.512362 12359 catalog_manager.cc:1347] Generated new cluster ID: 99673867641b4842a4a97301c6c7232c
I20260806 20:36:31.512493 12359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:31.540539 12359 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:31.541993 12359 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:31.549463 12359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3: Generated new TSK 0
I20260806 20:36:31.550525 12359 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
Entry for principal kudu/127.13.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab.
I20260806 20:36:31.632462 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42229
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:31.985769 12378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:31.986027 12378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:31.986132 12378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:31.993453 12378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:31.993609 12378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:31.993788 12378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:36:32.003731 12378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.65.keytab
--principal=kudu/127.13.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:32.005008 12378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:32.006304 12378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:32.019716 12386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:32.019735 12387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:32.019713 12390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:32.025153 12378 server_base.cc:1034] running on GCE node
I20260806 20:36:32.025759 12378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:32.026695 12378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:32.027925 12378 hybrid_clock.cc:648] HybridClock initialized: now 1786048592027889 us; error 50 us; skew 500 ppm
I20260806 20:36:32.028239 12378 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:32 dist-test-slave-2kcd krb5kdc[12227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048592, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:32.031481 12378 init.cc:377] Logged in from keytab as kudu/127.13.149.65@KRBTEST.COM (short username kudu)
I20260806 20:36:32.032953 12378 webserver.cc:460] Webserver started at http://127.13.149.65:36461/ using document root <none> and password file <none>
I20260806 20:36:32.033654 12378 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:32.033754 12378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:32.034016 12378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:32.036937 12378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "3bbd94f74ac94cf99516ab9d5333ba83"
format_stamp: "Formatted at 2026-08-06 20:36:32 on dist-test-slave-2kcd"
server_key: "317821abe36080a9057b741f08572859"
server_key_iv: "7c13a7dabde52a589f253ea31b8f71f7"
server_key_version: "encryptionkey@0"
I20260806 20:36:32.037667 12378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "3bbd94f74ac94cf99516ab9d5333ba83"
format_stamp: "Formatted at 2026-08-06 20:36:32 on dist-test-slave-2kcd"
server_key: "317821abe36080a9057b741f08572859"
server_key_iv: "7c13a7dabde52a589f253ea31b8f71f7"
server_key_version: "encryptionkey@0"
I20260806 20:36:32.042730 12378 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:36:32.046160 12402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:32.047431 12378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:36:32.047614 12378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "3bbd94f74ac94cf99516ab9d5333ba83"
format_stamp: "Formatted at 2026-08-06 20:36:32 on dist-test-slave-2kcd"
server_key: "317821abe36080a9057b741f08572859"
server_key_iv: "7c13a7dabde52a589f253ea31b8f71f7"
server_key_version: "encryptionkey@0"
I20260806 20:36:32.047812 12378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:32.065316 12378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:32.069680 12378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:32.070009 12378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:32.070989 12378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:32.072291 12378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:32.072364 12378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:32.072546 12378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:32.072609 12378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:32.106365 12378 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:32953
I20260806 20:36:32.106415 12589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:32953 every 8 connection(s)
I20260806 20:36:32.107684 12378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:36:32.115617 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 12378
I20260806 20:36:32.115801 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:36:32.116329 13909 external_mini_cluster.cc:1428] Setting key 1b520b81c94aaa832f515e35227d0273
Aug 06 20:36:32 dist-test-slave-2kcd krb5kdc[12227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048592, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.65@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:32.128960 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:32.110192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:59645 (local address 127.13.149.126:42229)
0806 20:36:32.110692 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:32.110696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:32.111551 (+ 855us) server_negotiation.cc:407] Connection header received
0806 20:36:32.113451 (+ 1900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:32.113457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:32.113564 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:32.113688 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:32.115321 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.116253 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.118442 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.119028 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.119171 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:32.123196 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:32.123201 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:32.123205 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:32.123236 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:32.125773 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:32.126687 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:32.126691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:32.126693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:32.126805 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:32.127272 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:32.127275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:32.127277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:32.127517 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:32.127635 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:32.128464 (+ 829us) server_negotiation.cc:299] Negotiation successful
0806 20:36:32.128635 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":278,"threads_started":1}
I20260806 20:36:32.130517 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:32.110715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42229 (local address 127.13.149.65:59645)
0806 20:36:32.111392 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:32.111429 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:32.113177 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:32.113923 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:32.113931 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:32.114436 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:32.115137 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:32.115157 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.116422 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.116430 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:32.118245 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:32.118261 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.119240 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.119264 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:32.119458 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:32.120151 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:32.120176 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:32.122962 (+ 2786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:32.125910 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:32.125922 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:32.125938 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:32.126564 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:32.126907 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:32.126915 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:32.126921 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:32.127159 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:32.127643 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:32.127653 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:32.128076 (+ 423us) client_negotiation.cc:769] Sending connection context
0806 20:36:32.128387 (+ 311us) client_negotiation.cc:240] Negotiation successful
0806 20:36:32.128970 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":267,"threads_started":1}
I20260806 20:36:32.131995 12590 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42229
I20260806 20:36:32.132299 12590 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:32.133203 12590 heartbeater.cc:511] Master 127.13.149.126:42229 requested a full tablet report, sending...
I20260806 20:36:32.135543 12292 ts_manager.cc:194] Registered new tserver with Master: 3bbd94f74ac94cf99516ab9d5333ba83 (127.13.149.65:32953)
I20260806 20:36:32.137066 12292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.65@KRBTEST.COM'} at 127.13.149.65:59645
WARNING: no policy specified for kudu/127.13.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
Entry for principal kudu/127.13.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab.
I20260806 20:36:32.185845 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42229
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:32.529817 12598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:32.530081 12598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:32.530273 12598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:32.537427 12598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:32.537557 12598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:32.537755 12598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:36:32.547329 12598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.66.keytab
--principal=kudu/127.13.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:32.548619 12598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:32.550015 12598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:32.563731 12615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:32.563771 12611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:32.563795 12612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:32.566211 12598 server_base.cc:1034] running on GCE node
I20260806 20:36:32.566815 12598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:32.567781 12598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:32.569032 12598 hybrid_clock.cc:648] HybridClock initialized: now 1786048592568977 us; error 66 us; skew 500 ppm
I20260806 20:36:32.569355 12598 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:32 dist-test-slave-2kcd krb5kdc[12227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048592, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:32.572669 12598 init.cc:377] Logged in from keytab as kudu/127.13.149.66@KRBTEST.COM (short username kudu)
I20260806 20:36:32.574210 12598 webserver.cc:460] Webserver started at http://127.13.149.66:33967/ using document root <none> and password file <none>
I20260806 20:36:32.574915 12598 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:32.575068 12598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:32.575384 12598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:32.578423 12598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "f9c0e8a38daf487ebb3f6f7f90262060"
format_stamp: "Formatted at 2026-08-06 20:36:32 on dist-test-slave-2kcd"
server_key: "a2447c04f8936ca77e2c844ce7fdb860"
server_key_iv: "ef7f1369304d06475ed9241b54e09363"
server_key_version: "encryptionkey@0"
I20260806 20:36:32.579208 12598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "f9c0e8a38daf487ebb3f6f7f90262060"
format_stamp: "Formatted at 2026-08-06 20:36:32 on dist-test-slave-2kcd"
server_key: "a2447c04f8936ca77e2c844ce7fdb860"
server_key_iv: "ef7f1369304d06475ed9241b54e09363"
server_key_version: "encryptionkey@0"
I20260806 20:36:32.584367 12598 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:36:32.588233 12624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:32.589618 12598 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 20:36:32.589795 12598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "f9c0e8a38daf487ebb3f6f7f90262060"
format_stamp: "Formatted at 2026-08-06 20:36:32 on dist-test-slave-2kcd"
server_key: "a2447c04f8936ca77e2c844ce7fdb860"
server_key_iv: "ef7f1369304d06475ed9241b54e09363"
server_key_version: "encryptionkey@0"
I20260806 20:36:32.590003 12598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:32.613493 12598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:32.617858 12598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:32.618172 12598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:32.619140 12598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:32.620467 12598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:32.620584 12598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:32.620738 12598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:32.620831 12598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 20:36:32.654875 12598 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:39209
I20260806 20:36:32.654971 12787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:39209 every 8 connection(s)
I20260806 20:36:32.656221 12598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:36:32.657243 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 12598
I20260806 20:36:32.657447 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:36:32.658046 13909 external_mini_cluster.cc:1428] Setting key 886e562ed2b9468d5406ae66cdd7924a
Aug 06 20:36:32 dist-test-slave-2kcd krb5kdc[12227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048592, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.66@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:32.676647 12790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:32.659117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:45021 (local address 127.13.149.126:42229)
0806 20:36:32.659631 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:32.659638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:32.660763 (+ 1125us) server_negotiation.cc:407] Connection header received
0806 20:36:32.662649 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:32.662657 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:32.662747 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:32.662864 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:32.664330 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.665128 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.666690 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.667123 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.667253 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:32.670908 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:32.670913 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:32.670916 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:32.670947 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:32.673592 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:32.674320 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:32.674326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:32.674330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:32.674497 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:32.674929 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:32.674940 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:32.674943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:32.675191 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:32.675353 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:32.676043 (+ 690us) server_negotiation.cc:299] Negotiation successful
0806 20:36:32.676265 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":242,"threads_started":1}
I20260806 20:36:32.677637 12794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:32.659788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42229 (local address 127.13.149.66:45021)
0806 20:36:32.660605 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:32.660654 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:32.662388 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:32.663106 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:32.663114 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:32.663611 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:32.664162 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:32.664178 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.665287 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.665297 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:32.666519 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:32.666531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:32.667355 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:32.667364 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:32.667585 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:32.668274 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:32.668296 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:32.670678 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:32.673742 (+ 3064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:32.673750 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:32.673764 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:32.674169 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:32.674612 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:32.674616 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:32.674620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:32.674805 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:32.675323 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:32.675330 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:32.675662 (+ 332us) client_negotiation.cc:769] Sending connection context
0806 20:36:32.675942 (+ 280us) client_negotiation.cc:240] Negotiation successful
0806 20:36:32.676456 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":357,"threads_started":1}
I20260806 20:36:32.679152 12788 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42229
I20260806 20:36:32.679546 12788 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:32.680418 12788 heartbeater.cc:511] Master 127.13.149.126:42229 requested a full tablet report, sending...
I20260806 20:36:32.682197 12292 ts_manager.cc:194] Registered new tserver with Master: f9c0e8a38daf487ebb3f6f7f90262060 (127.13.149.66:39209)
I20260806 20:36:32.683511 12292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.66@KRBTEST.COM'} at 127.13.149.66:45021
WARNING: no policy specified for kudu/127.13.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
Entry for principal kudu/127.13.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab.
I20260806 20:36:32.731827 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42229
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:33.078184 12798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:33.078440 12798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:33.078532 12798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:33.085548 12798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:33.085645 12798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:33.085748 12798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:36:33.095530 12798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.67.keytab
--principal=kudu/127.13.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:33.096695 12798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:33.098016 12798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:33.111387 12805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:33.111467 12807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:33.111794 12804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:33.113229 12798 server_base.cc:1034] running on GCE node
I20260806 20:36:33.113859 12798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:33.114853 12798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:33.116058 12798 hybrid_clock.cc:648] HybridClock initialized: now 1786048593116018 us; error 26 us; skew 500 ppm
I20260806 20:36:33.116323 12798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:33 dist-test-slave-2kcd krb5kdc[12227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048593, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:33.119486 12798 init.cc:377] Logged in from keytab as kudu/127.13.149.67@KRBTEST.COM (short username kudu)
I20260806 20:36:33.121012 12798 webserver.cc:460] Webserver started at http://127.13.149.67:36219/ using document root <none> and password file <none>
I20260806 20:36:33.121692 12798 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:33.121834 12798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:33.122164 12798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:33.125059 12798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9"
format_stamp: "Formatted at 2026-08-06 20:36:33 on dist-test-slave-2kcd"
server_key: "e38ea3d0e2d2f676fca8a8840b4bd517"
server_key_iv: "3c71ed28d496ea445a16814fc3d72955"
server_key_version: "encryptionkey@0"
I20260806 20:36:33.125838 12798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9"
format_stamp: "Formatted at 2026-08-06 20:36:33 on dist-test-slave-2kcd"
server_key: "e38ea3d0e2d2f676fca8a8840b4bd517"
server_key_iv: "3c71ed28d496ea445a16814fc3d72955"
server_key_version: "encryptionkey@0"
I20260806 20:36:33.130921 12798 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 20:36:33.134341 12815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:33.135583 12798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 20:36:33.135759 12798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9"
format_stamp: "Formatted at 2026-08-06 20:36:33 on dist-test-slave-2kcd"
server_key: "e38ea3d0e2d2f676fca8a8840b4bd517"
server_key_iv: "3c71ed28d496ea445a16814fc3d72955"
server_key_version: "encryptionkey@0"
I20260806 20:36:33.135955 12798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:33.140704 12590 heartbeater.cc:503] Master 127.13.149.126:42229 was elected leader, sending a full tablet report...
I20260806 20:36:33.156647 12798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:33.160513 12798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:33.160753 12798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:33.161665 12798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:33.162864 12798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:33.162951 12798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:33.163030 12798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:33.163075 12798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:33.197371 12798 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:45389
I20260806 20:36:33.197425 12974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:45389 every 8 connection(s)
I20260806 20:36:33.198746 12798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:36:33.205003 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 12798
I20260806 20:36:33.205224 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:36:33.205713 13909 external_mini_cluster.cc:1428] Setting key c9a489fac8f8dc5cd68282ae2161ff3d
Aug 06 20:36:33 dist-test-slave-2kcd krb5kdc[12227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048593, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.67@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:36:33.219738 12979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.201332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:43033 (local address 127.13.149.126:42229)
0806 20:36:33.201804 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.201809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.202751 (+ 942us) server_negotiation.cc:407] Connection header received
0806 20:36:33.204600 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.204606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.204695 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.204835 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:33.206597 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.207693 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.209346 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.209762 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.209896 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.213433 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:33.213438 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:33.213441 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:33.213474 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:33.216488 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.217316 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.217321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.217324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.217446 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.217890 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.217901 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.217904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.218165 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:33.218338 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.219121 (+ 783us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.219336 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":243,"threads_started":1}
I20260806 20:36:33.220741 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.201841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:42229 (local address 127.13.149.67:43033)
0806 20:36:33.202597 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:33.202633 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:33.204307 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:33.205080 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:33.205088 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:33.205680 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:33.206379 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.206407 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.207877 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.207881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.209195 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.209207 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.210005 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.210013 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.210243 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.210904 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:36:33.210925 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:33.213220 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:33.216661 (+ 3441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:33.216687 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:33.216709 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:33.217180 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:33.217562 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:36:33.217567 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:36:33.217571 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:36:33.217764 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:36:33.218306 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:33.218314 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:33.218651 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 20:36:33.218958 (+ 307us) client_negotiation.cc:240] Negotiation successful
0806 20:36:33.219478 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":296,"threads_started":1}
I20260806 20:36:33.222087 12976 heartbeater.cc:347] Connected to a master server at 127.13.149.126:42229
I20260806 20:36:33.222348 12976 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:33.223024 12976 heartbeater.cc:511] Master 127.13.149.126:42229 requested a full tablet report, sending...
I20260806 20:36:33.224282 12292 ts_manager.cc:194] Registered new tserver with Master: 6120cb42c01e4b40ba8a2958a3b2c5f9 (127.13.149.67:45389)
I20260806 20:36:33.225104 12292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.149.67@KRBTEST.COM'} at 127.13.149.67:43033
I20260806 20:36:33.233801 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:36:33.250511 12979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.238037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60384 (local address 127.13.149.126:42229)
0806 20:36:33.238198 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.238202 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.238604 (+ 402us) server_negotiation.cc:407] Connection header received
0806 20:36:33.238785 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.238793 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.238859 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.238946 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:33.240494 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.241246 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.242500 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.242871 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.242969 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.245326 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:33.245331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:33.245334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:33.245365 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:33.248037 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.248622 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.248625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.248627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.248741 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.249151 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.249154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.249156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.249593 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:33.249829 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.250108 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.250268 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 20:36:33.254451 12292 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:36:33.261140 12292 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:36:33.293694 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.272841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35106 (local address 127.13.149.66:39209)
0806 20:36:33.283223 (+ 10382us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.283236 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.283275 (+ 39us) server_negotiation.cc:407] Connection header received
0806 20:36:33.283414 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.283426 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.283740 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.284725 (+ 985us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:33.285941 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.287507 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.290358 (+ 2851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.291984 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.292132 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.292419 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.293134 (+ 715us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.293317 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10177,"thread_start_us":9994,"threads_started":1}
I20260806 20:36:33.294256 13001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.273251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36174 (local address 127.13.149.65:32953)
0806 20:36:33.284758 (+ 11507us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.284769 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.284823 (+ 54us) server_negotiation.cc:407] Connection header received
0806 20:36:33.284941 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.284952 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.285215 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.286709 (+ 1494us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:33.286985 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.288642 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.290930 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.292366 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.292534 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.292765 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.293645 (+ 880us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.293821 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11290,"thread_start_us":11087,"threads_started":1}
I20260806 20:36:33.294256 13004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.273061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:32953 (local address 127.0.0.1:36174)
0806 20:36:33.283730 (+ 10669us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:33.283756 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:33.283897 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:33.285798 (+ 1901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:33.285806 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:33.285843 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:33.286456 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.286473 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.288820 (+ 2347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.288828 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.290743 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.290775 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.292600 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.292607 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.293041 (+ 434us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.293081 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 20:36:33.293224 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 20:36:33.293349 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10512,"thread_start_us":12562,"threads_started":1}
I20260806 20:36:33.294775 12996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.272735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:39209 (local address 127.0.0.1:35106)
0806 20:36:33.273663 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:33.273709 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:33.273897 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:33.285146 (+ 11249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:33.285157 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:33.285199 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:33.285678 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.285697 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.287665 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.287670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.290190 (+ 2520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.290207 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.292230 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.292236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.292520 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.292607 (+ 87us) client_negotiation.cc:769] Sending connection context
0806 20:36:33.292722 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 20:36:33.292950 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":47,"thread_start_us":1367,"threads_started":1}
I20260806 20:36:33.295452 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.273356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:45389 (local address 127.0.0.1:43866)
0806 20:36:33.286278 (+ 12922us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:33.286306 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:33.286437 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:33.288147 (+ 1710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:33.288152 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:33.288175 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:33.288594 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.288603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.290833 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.290841 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.292463 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.292479 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.294650 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.294657 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.294847 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.294884 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 20:36:33.294958 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 20:36:33.295100 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12793,"mutex_wait_us":29,"thread_start_us":10639,"threads_started":1}
I20260806 20:36:33.297742 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.273969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43866 (local address 127.13.149.67:45389)
0806 20:36:33.287693 (+ 13724us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.287699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.287724 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:36:33.287800 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.287804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.287964 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.288152 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:33.288828 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.290680 (+ 1852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.292674 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.294390 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.295777 (+ 1387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.297166 (+ 1389us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.297239 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.297405 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13526,"thread_start_us":13341,"threads_started":1}
I20260806 20:36:33.298250 12498 tablet_service.cc:1467] Processing CreateTablet for tablet 07cab28c68624ca9903f4624219f12ec (DEFAULT_TABLE table=test-table [id=23797cd4ee2d4a1f9a1c542853c5c0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:33.298249 12698 tablet_service.cc:1467] Processing CreateTablet for tablet 07cab28c68624ca9903f4624219f12ec (DEFAULT_TABLE table=test-table [id=23797cd4ee2d4a1f9a1c542853c5c0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:33.299486 12498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07cab28c68624ca9903f4624219f12ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:33.299597 12698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07cab28c68624ca9903f4624219f12ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:33.302109 12885 tablet_service.cc:1467] Processing CreateTablet for tablet 07cab28c68624ca9903f4624219f12ec (DEFAULT_TABLE table=test-table [id=23797cd4ee2d4a1f9a1c542853c5c0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:33.303215 12885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07cab28c68624ca9903f4624219f12ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:33.313463 13012 tablet_bootstrap.cc:492] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Bootstrap starting.
I20260806 20:36:33.318190 13014 tablet_bootstrap.cc:492] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Bootstrap starting.
I20260806 20:36:33.318361 13012 tablet_bootstrap.cc:654] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:33.320632 13013 tablet_bootstrap.cc:492] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Bootstrap starting.
I20260806 20:36:33.320966 13012 log.cc:824] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:33.321635 13014 tablet_bootstrap.cc:654] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:33.323153 13014 log.cc:824] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:33.324131 13013 tablet_bootstrap.cc:654] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:33.324892 13012 tablet_bootstrap.cc:492] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: No bootstrap required, opened a new log
I20260806 20:36:33.325242 13012 ts_tablet_manager.cc:1397] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260806 20:36:33.325418 13013 log.cc:824] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:33.325809 13014 tablet_bootstrap.cc:492] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: No bootstrap required, opened a new log
I20260806 20:36:33.326071 13014 ts_tablet_manager.cc:1397] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 20:36:33.330761 13013 tablet_bootstrap.cc:492] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: No bootstrap required, opened a new log
I20260806 20:36:33.331061 13013 ts_tablet_manager.cc:1397] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260806 20:36:33.333796 13014 raft_consensus.cc:348] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.334165 13014 raft_consensus.cc:374] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:33.334293 13014 raft_consensus.cc:729] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bbd94f74ac94cf99516ab9d5333ba83, State: Initialized, Role: FOLLOWER
I20260806 20:36:33.334913 13014 consensus_queue.cc:260] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.336711 13014 ts_tablet_manager.cc:1428] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260806 20:36:33.337306 13012 raft_consensus.cc:348] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.337752 13012 raft_consensus.cc:374] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:33.337850 13012 raft_consensus.cc:729] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9c0e8a38daf487ebb3f6f7f90262060, State: Initialized, Role: FOLLOWER
I20260806 20:36:33.338449 13012 consensus_queue.cc:260] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.344077 13013 raft_consensus.cc:348] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.344635 13013 raft_consensus.cc:374] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:33.344755 13013 raft_consensus.cc:729] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6120cb42c01e4b40ba8a2958a3b2c5f9, State: Initialized, Role: FOLLOWER
I20260806 20:36:33.345361 12788 heartbeater.cc:503] Master 127.13.149.126:42229 was elected leader, sending a full tablet report...
I20260806 20:36:33.345391 13013 consensus_queue.cc:260] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.346537 12976 heartbeater.cc:503] Master 127.13.149.126:42229 was elected leader, sending a full tablet report...
I20260806 20:36:33.346909 13012 ts_tablet_manager.cc:1428] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Time spent starting tablet: real 0.022s user 0.013s sys 0.008s
I20260806 20:36:33.348088 13013 ts_tablet_manager.cc:1428] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
W20260806 20:36:33.360174 12592 tablet.cc:2369] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 20:36:33.408480 12789 tablet.cc:2369] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:33.423911 13020 raft_consensus.cc:482] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:36:33.424203 13020 raft_consensus.cc:504] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.425928 13020 leader_election.cc:288] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9c0e8a38daf487ebb3f6f7f90262060 (127.13.149.66:39209), 3bbd94f74ac94cf99516ab9d5333ba83 (127.13.149.65:32953)
I20260806 20:36:33.431847 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.426489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:60387 (local address 127.13.149.66:39209)
0806 20:36:33.426745 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.426757 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.426834 (+ 77us) server_negotiation.cc:407] Connection header received
0806 20:36:33.427102 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.427110 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.427178 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.427279 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:33.427696 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.428432 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.430127 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.430926 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.431096 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.431205 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.431458 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.431592 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:36:33.432232 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.426340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:39209 (local address 127.13.149.67:60387)
0806 20:36:33.426737 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:33.426759 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:33.426940 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:33.427300 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:33.427305 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:33.427337 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:33.427552 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.427561 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.428587 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.428595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.429955 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.429968 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.431096 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.431102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.431297 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.431321 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 20:36:33.431429 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 20:36:33.431558 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235}
I20260806 20:36:33.432724 13001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.426562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:55045 (local address 127.13.149.65:32953)
0806 20:36:33.426756 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.426763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.427445 (+ 682us) server_negotiation.cc:407] Connection header received
0806 20:36:33.427668 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.427672 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.427732 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.427834 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:33.428382 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.429195 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.430886 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.431669 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.431855 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.431925 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.432307 (+ 382us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.432476 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 20:36:33.432760 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.426418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:32953 (local address 127.13.149.67:55045)
0806 20:36:33.427322 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:33.427337 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:33.427500 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:33.427850 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:33.427854 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:33.427877 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:33.428220 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.428229 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.429352 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.429357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.430721 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:33.430733 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.431888 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.431896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:33.432050 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.432106 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 20:36:33.432236 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 20:36:33.432388 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"thread_start_us":532,"threads_started":1}
I20260806 20:36:33.433485 12720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07cab28c68624ca9903f4624219f12ec" candidate_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" is_pre_election: true
I20260806 20:36:33.434067 12720 raft_consensus.cc:2454] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6120cb42c01e4b40ba8a2958a3b2c5f9 in term 0.
I20260806 20:36:33.433975 12526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07cab28c68624ca9903f4624219f12ec" candidate_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" is_pre_election: true
I20260806 20:36:33.434486 12526 raft_consensus.cc:2454] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6120cb42c01e4b40ba8a2958a3b2c5f9 in term 0.
I20260806 20:36:33.434813 12820 leader_election.cc:302] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6120cb42c01e4b40ba8a2958a3b2c5f9, f9c0e8a38daf487ebb3f6f7f90262060; no voters:
I20260806 20:36:33.435283 13020 raft_consensus.cc:2781] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:36:33.435487 13020 raft_consensus.cc:482] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:36:33.435598 13020 raft_consensus.cc:3037] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:33.438006 13020 raft_consensus.cc:504] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
I20260806 20:36:33.438725 13020 leader_election.cc:288] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [CANDIDATE]: Term 1 election: Requested vote from peers f9c0e8a38daf487ebb3f6f7f90262060 (127.13.149.66:39209), 3bbd94f74ac94cf99516ab9d5333ba83 (127.13.149.65:32953)
I20260806 20:36:33.439177 12720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07cab28c68624ca9903f4624219f12ec" candidate_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c0e8a38daf487ebb3f6f7f90262060"
I20260806 20:36:33.439267 12526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07cab28c68624ca9903f4624219f12ec" candidate_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bbd94f74ac94cf99516ab9d5333ba83"
I20260806 20:36:33.439409 12720 raft_consensus.cc:3037] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:33.439465 12526 raft_consensus.cc:3037] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:33.442824 12720 raft_consensus.cc:2454] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6120cb42c01e4b40ba8a2958a3b2c5f9 in term 1.
I20260806 20:36:33.442824 12526 raft_consensus.cc:2454] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6120cb42c01e4b40ba8a2958a3b2c5f9 in term 1.
I20260806 20:36:33.443277 12820 leader_election.cc:302] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6120cb42c01e4b40ba8a2958a3b2c5f9, f9c0e8a38daf487ebb3f6f7f90262060; no voters:
I20260806 20:36:33.443626 13020 raft_consensus.cc:2781] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:33.444108 13020 raft_consensus.cc:686] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 1 LEADER]: Becoming Leader. State: Replica: 6120cb42c01e4b40ba8a2958a3b2c5f9, State: Running, Role: LEADER
I20260806 20:36:33.444589 13020 consensus_queue.cc:237] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } }
W20260806 20:36:33.450426 12978 tablet.cc:2369] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:33.450349 12292 catalog_manager.cc:5495] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6120cb42c01e4b40ba8a2958a3b2c5f9 (127.13.149.67). New cstate: current_term: 1 leader_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6120cb42c01e4b40ba8a2958a3b2c5f9" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 45389 } health_report { overall_health: HEALTHY } } }
I20260806 20:36:33.491236 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.486128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43872 (local address 127.13.149.67:45389)
0806 20:36:33.486364 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.486370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.486389 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:36:33.486555 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.486559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.486648 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.486772 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:36:33.487100 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.487796 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.489217 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.489601 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.489694 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.490110 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:36:33.490595 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:36:33.490767 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.490850 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.490933 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 20:36:33.500083 12720 raft_consensus.cc:1261] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 1 FOLLOWER]: Refusing update from remote peer 6120cb42c01e4b40ba8a2958a3b2c5f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:33.500248 12526 raft_consensus.cc:1261] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 1 FOLLOWER]: Refusing update from remote peer 6120cb42c01e4b40ba8a2958a3b2c5f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:33.501228 13022 consensus_queue.cc:1035] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9c0e8a38daf487ebb3f6f7f90262060" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:33.501576 13020 consensus_queue.cc:1035] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bbd94f74ac94cf99516ab9d5333ba83" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 32953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:33.512455 13025 mvcc.cc:205] Tried to move back new op lower bound from 7315655038964985856 to 7315655038754934784. Current Snapshot: MvccSnapshot[applied={T|T < 7315655038964985856}]
I20260806 20:36:33.516165 13027 mvcc.cc:205] Tried to move back new op lower bound from 7315655038964985856 to 7315655038754934784. Current Snapshot: MvccSnapshot[applied={T|T < 7315655038964985856}]
I20260806 20:36:33.526085 12290 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:33.526314 12290 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:33.530026 12290 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e70e29ce2a24a7f9b1b885bfbb120e3: Sending DeleteTablet for 3 replicas of tablet 07cab28c68624ca9903f4624219f12ec
I20260806 20:36:33.531267 12698 tablet_service.cc:1514] Processing DeleteTablet for tablet 07cab28c68624ca9903f4624219f12ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:33 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:35106
I20260806 20:36:33.531322 12498 tablet_service.cc:1514] Processing DeleteTablet for tablet 07cab28c68624ca9903f4624219f12ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:33 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:36174
I20260806 20:36:33.531472 12885 tablet_service.cc:1514] Processing DeleteTablet for tablet 07cab28c68624ca9903f4624219f12ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:33 UTC) from {username='kudu', principal='kudu/127.13.149.126@KRBTEST.COM'} at 127.0.0.1:43866
I20260806 20:36:33.533537 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 12378
I20260806 20:36:33.544000 13037 tablet_replica.cc:330] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: stopping tablet replica
I20260806 20:36:33.544494 13037 raft_consensus.cc:2229] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:33.546439 13037 raft_consensus.cc:2258] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:33.549336 13037 ts_tablet_manager.cc:1905] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:33.558017 13037 ts_tablet_manager.cc:1918] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:33.558270 13037 log.cc:1196] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/07cab28c68624ca9903f4624219f12ec
I20260806 20:36:33.558979 13037 ts_tablet_manager.cc:1939] T 07cab28c68624ca9903f4624219f12ec P f9c0e8a38daf487ebb3f6f7f90262060: Deleting consensus metadata
I20260806 20:36:33.561394 12270 catalog_manager.cc:4841] TS f9c0e8a38daf487ebb3f6f7f90262060 (127.13.149.66:39209): tablet 07cab28c68624ca9903f4624219f12ec (table test-table [id=23797cd4ee2d4a1f9a1c542853c5c0f9]) successfully deleted
I20260806 20:36:33.562146 13041 tablet_replica.cc:330] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: stopping tablet replica
I20260806 20:36:33.562570 13041 raft_consensus.cc:2229] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:36:33.563169 13040 tablet_replica.cc:330] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: stopping tablet replica
I20260806 20:36:33.563328 13041 raft_consensus.cc:2258] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:33.563575 13040 raft_consensus.cc:2229] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:33.564083 13040 raft_consensus.cc:2258] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:33.566567 13040 ts_tablet_manager.cc:1905] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:33.566756 13041 ts_tablet_manager.cc:1905] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:33.572357 13040 ts_tablet_manager.cc:1918] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:33.572567 13040 log.cc:1196] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/07cab28c68624ca9903f4624219f12ec
I20260806 20:36:33.573262 13040 ts_tablet_manager.cc:1939] T 07cab28c68624ca9903f4624219f12ec P 3bbd94f74ac94cf99516ab9d5333ba83: Deleting consensus metadata
I20260806 20:36:33.574187 13041 ts_tablet_manager.cc:1918] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:33.574415 13041 log.cc:1196] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/07cab28c68624ca9903f4624219f12ec
I20260806 20:36:33.574991 13041 ts_tablet_manager.cc:1939] T 07cab28c68624ca9903f4624219f12ec P 6120cb42c01e4b40ba8a2958a3b2c5f9: Deleting consensus metadata
I20260806 20:36:33.575295 12271 catalog_manager.cc:4841] TS 3bbd94f74ac94cf99516ab9d5333ba83 (127.13.149.65:32953): tablet 07cab28c68624ca9903f4624219f12ec (table test-table [id=23797cd4ee2d4a1f9a1c542853c5c0f9]) successfully deleted
Aug 06 20:36:33 dist-test-slave-2kcd krb5kdc[12227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.65@KRBTEST.COM
I20260806 20:36:33.576653 12268 catalog_manager.cc:4841] TS 6120cb42c01e4b40ba8a2958a3b2c5f9 (127.13.149.67:45389): tablet 07cab28c68624ca9903f4624219f12ec (table test-table [id=23797cd4ee2d4a1f9a1c542853c5c0f9]) successfully deleted
I20260806 20:36:33.584175 13001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.535126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36182 (local address 127.13.149.65:32953)
0806 20:36:33.535357 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.535366 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.558934 (+ 23568us) server_negotiation.cc:407] Connection header received
0806 20:36:33.559451 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.559457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.559549 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.559644 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:33.563783 (+ 4139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.565121 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.567025 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.567690 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.567817 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.577379 (+ 9562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:33.577394 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:33.577411 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:33.577455 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:33.581188 (+ 3733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.581908 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.581919 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.581923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.582092 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.582495 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.582501 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.582504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.582961 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:33.583261 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.583574 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.583796 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 20:36:33.584946 12585 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:33.686435 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 12378
I20260806 20:36:33.716903 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 12598
Aug 06 20:36:33 dist-test-slave-2kcd krb5kdc[12227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.66@KRBTEST.COM
I20260806 20:36:33.732833 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.717783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35108 (local address 127.13.149.66:39209)
0806 20:36:33.717968 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.717974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.717997 (+ 23us) server_negotiation.cc:407] Connection header received
0806 20:36:33.718120 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.718126 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.718199 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.718321 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:33.719612 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.720386 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.721962 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.722363 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.722501 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.726895 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:33.726910 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:33.726925 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:33.726959 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:33.729967 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.730669 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.730676 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.730678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.730796 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.731185 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.731202 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.731205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.731590 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:33.731905 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.732202 (+ 297us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.732432 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:36:33.733552 12783 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:33.832399 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 12598
I20260806 20:36:33.863323 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 12798
Aug 06 20:36:33 dist-test-slave-2kcd krb5kdc[12227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.67@KRBTEST.COM
I20260806 20:36:33.880668 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:33.864180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43876 (local address 127.13.149.67:45389)
0806 20:36:33.864405 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:33.864413 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:33.864520 (+ 107us) server_negotiation.cc:407] Connection header received
0806 20:36:33.864736 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:33.864745 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:33.864890 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:33.865012 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:33.866450 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.867274 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.868573 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:33.869117 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:33.869259 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:33.874167 (+ 4908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:33.874185 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:33.874203 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:33.874245 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:33.877469 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.878315 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.878322 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.878324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.878497 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:33.878994 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:33.878998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:33.879000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:33.879360 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:33.879632 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:33.880049 (+ 417us) server_negotiation.cc:299] Negotiation successful
0806 20:36:33.880210 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260806 20:36:33.881573 12967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:34.007789 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 12798
I20260806 20:36:34.035830 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 12247
I20260806 20:36:34.037050 12339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:34.149895 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 12247
2026-08-06T20:36:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4789 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T20:36:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:34Z Disabled control of system clock
I20260806 20:36:34.259644 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38831
--webserver_interface=127.13.149.126
--webserver_port=0
--builtin_ntp_servers=127.13.149.84:33681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:38831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 20:36:34.601174 13057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:34.601538 13057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:34.601706 13057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:34.609226 13057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:34.609405 13057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:34.609512 13057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:34.609630 13057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:34.609709 13057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:34.619313 13057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:38831
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:34.620767 13057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:34.623217 13057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:34.636000 13063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:34.635947 13064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:34.635948 13067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:34.636875 13057 server_base.cc:1034] running on GCE node
I20260806 20:36:34.637669 13057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:34.639528 13057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:34.640759 13057 hybrid_clock.cc:648] HybridClock initialized: now 1786048594640710 us; error 42 us; skew 500 ppm
I20260806 20:36:34.641171 13057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:34.643555 13057 webserver.cc:460] Webserver started at http://127.13.149.126:39679/ using document root <none> and password file <none>
I20260806 20:36:34.644272 13057 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:34.644414 13057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:34.644742 13057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:34.647681 13057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "53ba68e88c654a2ca7fab99cece2cbf9"
format_stamp: "Formatted at 2026-08-06 20:36:34 on dist-test-slave-2kcd"
server_key: "92cddabea5f8667c1dbcfc8a6bc1af48"
server_key_iv: "340bca669226b7a937f11e78616c9e45"
server_key_version: "encryptionkey@0"
I20260806 20:36:34.648502 13057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "53ba68e88c654a2ca7fab99cece2cbf9"
format_stamp: "Formatted at 2026-08-06 20:36:34 on dist-test-slave-2kcd"
server_key: "92cddabea5f8667c1dbcfc8a6bc1af48"
server_key_iv: "340bca669226b7a937f11e78616c9e45"
server_key_version: "encryptionkey@0"
I20260806 20:36:34.653755 13057 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 20:36:34.657269 13076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:34.658663 13057 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:36:34.658864 13057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "53ba68e88c654a2ca7fab99cece2cbf9"
format_stamp: "Formatted at 2026-08-06 20:36:34 on dist-test-slave-2kcd"
server_key: "92cddabea5f8667c1dbcfc8a6bc1af48"
server_key_iv: "340bca669226b7a937f11e78616c9e45"
server_key_version: "encryptionkey@0"
I20260806 20:36:34.659086 13057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:34.696503 13057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:34.697451 13057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:34.697772 13057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:34.716742 13057 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:38831
I20260806 20:36:34.716838 13159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:38831 every 8 connection(s)
I20260806 20:36:34.718083 13057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:34.721761 13160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:34.723989 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 13057
I20260806 20:36:34.724188 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:34.724651 13909 external_mini_cluster.cc:1428] Setting key b8e7f0948fd24c563796d6a041eb8562
I20260806 20:36:34.733426 13160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9: Bootstrap starting.
I20260806 20:36:34.737176 13160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:34.738294 13160 log.cc:824] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:34.738391 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:34.726580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.13.149.126:38831)
0806 20:36:34.727570 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:34.727579 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:34.727620 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:36:34.729364 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:34.729392 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:34.729804 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:34.730121 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:34.730748 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:34.732046 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:34.734049 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:34.734725 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:34.734874 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:34.736154 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:34.736161 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:34.736173 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:34.736678 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:34.736754 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:34.736774 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:34.736931 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:34.737170 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 20:36:34.737477 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":406,"threads_started":1}
I20260806 20:36:34.741281 13160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9: No bootstrap required, opened a new log
I20260806 20:36:34.748334 13160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38831 } }
I20260806 20:36:34.748720 13160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:34.748854 13160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ba68e88c654a2ca7fab99cece2cbf9, State: Initialized, Role: FOLLOWER
I20260806 20:36:34.749454 13160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38831 } }
I20260806 20:36:34.749764 13160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:34.749912 13160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:34.750102 13160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:34.752471 13160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38831 } }
I20260806 20:36:34.753029 13160 leader_election.cc:302] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53ba68e88c654a2ca7fab99cece2cbf9; no voters:
I20260806 20:36:34.753615 13160 leader_election.cc:288] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:34.753756 13169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:34.754880 13169 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [term 1 LEADER]: Becoming Leader. State: Replica: 53ba68e88c654a2ca7fab99cece2cbf9, State: Running, Role: LEADER
I20260806 20:36:34.755342 13169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38831 } }
I20260806 20:36:34.755507 13160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:34.758085 13171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53ba68e88c654a2ca7fab99cece2cbf9. Latest consensus state: current_term: 1 leader_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38831 } } }
I20260806 20:36:34.758169 13170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ba68e88c654a2ca7fab99cece2cbf9" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38831 } } }
I20260806 20:36:34.758579 13171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:34.758608 13170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:34.761529 13179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:34.768191 13179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:34.777333 13179 catalog_manager.cc:1347] Generated new cluster ID: e13407e69ac64a6099d76f83ffcb2817
I20260806 20:36:34.777441 13179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:34.799703 13179 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:34.801038 13179 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:34.814078 13179 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9: Generated new TSK 0
I20260806 20:36:34.814929 13179 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:34.822995 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.65:0
--local_ip_for_outbound_sockets=127.13.149.65
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38831
--builtin_ntp_servers=127.13.149.84:33681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 20:36:35.189049 13196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:35.189343 13196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:35.189508 13196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:35.196476 13196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:35.196602 13196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:35.196769 13196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.65
I20260806 20:36:35.205963 13196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.149.65
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.65
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:35.207139 13196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:35.208950 13196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:35.221971 13205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:35.222028 13201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:35.222059 13202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:35.226253 13196 server_base.cc:1034] running on GCE node
I20260806 20:36:35.226817 13196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:35.227725 13196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:35.228962 13196 hybrid_clock.cc:648] HybridClock initialized: now 1786048595228917 us; error 53 us; skew 500 ppm
I20260806 20:36:35.229269 13196 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:35.231624 13196 webserver.cc:460] Webserver started at http://127.13.149.65:34187/ using document root <none> and password file <none>
I20260806 20:36:35.232293 13196 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:35.232432 13196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:35.232758 13196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:35.235612 13196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data/instance:
uuid: "dc6b649bb2c24a19a6f2c9817f15dc06"
format_stamp: "Formatted at 2026-08-06 20:36:35 on dist-test-slave-2kcd"
server_key: "606d52920634d4d56dcb766ccdbce569"
server_key_iv: "d604aa1e2f11fe209ea74fe933718a04"
server_key_version: "encryptionkey@0"
I20260806 20:36:35.236408 13196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance:
uuid: "dc6b649bb2c24a19a6f2c9817f15dc06"
format_stamp: "Formatted at 2026-08-06 20:36:35 on dist-test-slave-2kcd"
server_key: "606d52920634d4d56dcb766ccdbce569"
server_key_iv: "d604aa1e2f11fe209ea74fe933718a04"
server_key_version: "encryptionkey@0"
I20260806 20:36:35.241899 13196 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260806 20:36:35.245223 13212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:35.246526 13196 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:36:35.246706 13196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal
uuid: "dc6b649bb2c24a19a6f2c9817f15dc06"
format_stamp: "Formatted at 2026-08-06 20:36:35 on dist-test-slave-2kcd"
server_key: "606d52920634d4d56dcb766ccdbce569"
server_key_iv: "d604aa1e2f11fe209ea74fe933718a04"
server_key_version: "encryptionkey@0"
I20260806 20:36:35.246932 13196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:35.289762 13196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:35.290678 13196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:35.291002 13196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:35.292112 13196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:35.293696 13196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:35.293828 13196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:35.293960 13196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:35.294050 13196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:35.328536 13196 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.65:33815
I20260806 20:36:35.328610 13380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.65:33815 every 8 connection(s)
I20260806 20:36:35.329972 13196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/data/info.pb
I20260806 20:36:35.332418 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 13196
I20260806 20:36:35.332639 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal/instance
I20260806 20:36:35.333312 13909 external_mini_cluster.cc:1428] Setting key 4a4778b82c1efeff47e15c46e796cf43
I20260806 20:36:35.336611 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.66:0
--local_ip_for_outbound_sockets=127.13.149.66
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38831
--builtin_ntp_servers=127.13.149.84:33681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 20:36:35.345057 13383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:35.332616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.65:49189 (local address 127.13.149.126:38831)
0806 20:36:35.333189 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:35.333195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:35.334540 (+ 1345us) server_negotiation.cc:407] Connection header received
0806 20:36:35.336962 (+ 2422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:35.336972 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:35.337038 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:35.337131 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:35.338618 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.339320 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.341912 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.342357 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.342478 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:35.344158 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:35.344163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:35.344166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:35.344186 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:35.344239 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:35.344252 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:35.344335 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:35.344608 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 20:36:35.344691 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":284,"threads_started":1}
I20260806 20:36:35.346556 13384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:35.333250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38831 (local address 127.13.149.65:49189)
0806 20:36:35.334354 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:35.334402 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:35.336638 (+ 2236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:35.337411 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:35.337426 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:35.337548 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:35.338416 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:35.338451 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.339503 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.339512 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:35.341698 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:35.341718 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.342602 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.342611 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:35.342952 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:35.343766 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:35.343771 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:35.343833 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:35.343941 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:35.344359 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:35.344373 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:35.344383 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 20:36:35.344582 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 20:36:35.345054 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":349,"threads_started":1}
I20260806 20:36:35.348205 13381 heartbeater.cc:347] Connected to a master server at 127.13.149.126:38831
I20260806 20:36:35.348546 13381 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:35.349565 13381 heartbeater.cc:511] Master 127.13.149.126:38831 requested a full tablet report, sending...
I20260806 20:36:35.352087 13104 ts_manager.cc:194] Registered new tserver with Master: dc6b649bb2c24a19a6f2c9817f15dc06 (127.13.149.65:33815)
I20260806 20:36:35.353714 13104 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.65:49189
W20260806 20:36:35.687644 13386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:35.687964 13386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:35.688144 13386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:35.695432 13386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:35.695566 13386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:35.695750 13386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.66
I20260806 20:36:35.704628 13386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.149.66
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.66
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:35.706086 13386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:35.707823 13386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:35.722455 13394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:35.722425 13393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:35.723351 13398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:35.724013 13386 server_base.cc:1034] running on GCE node
I20260806 20:36:35.724651 13386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:35.725700 13386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:35.726948 13386 hybrid_clock.cc:648] HybridClock initialized: now 1786048595726878 us; error 55 us; skew 500 ppm
I20260806 20:36:35.727276 13386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:35.729785 13386 webserver.cc:460] Webserver started at http://127.13.149.66:37981/ using document root <none> and password file <none>
I20260806 20:36:35.730597 13386 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:35.730710 13386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:35.731057 13386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:35.734889 13386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data/instance:
uuid: "e31bace7b79442efbaa3137a809d9f95"
format_stamp: "Formatted at 2026-08-06 20:36:35 on dist-test-slave-2kcd"
server_key: "b363c5fd2de38fb2803885ea5f06a9e4"
server_key_iv: "7f0fe7a91745c5b4f1450f041a101d07"
server_key_version: "encryptionkey@0"
I20260806 20:36:35.735859 13386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance:
uuid: "e31bace7b79442efbaa3137a809d9f95"
format_stamp: "Formatted at 2026-08-06 20:36:35 on dist-test-slave-2kcd"
server_key: "b363c5fd2de38fb2803885ea5f06a9e4"
server_key_iv: "7f0fe7a91745c5b4f1450f041a101d07"
server_key_version: "encryptionkey@0"
I20260806 20:36:35.741993 13386 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 20:36:35.745494 13404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:35.746819 13386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:36:35.747004 13386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal
uuid: "e31bace7b79442efbaa3137a809d9f95"
format_stamp: "Formatted at 2026-08-06 20:36:35 on dist-test-slave-2kcd"
server_key: "b363c5fd2de38fb2803885ea5f06a9e4"
server_key_iv: "7f0fe7a91745c5b4f1450f041a101d07"
server_key_version: "encryptionkey@0"
I20260806 20:36:35.747232 13386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:35.765482 13386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:35.766290 13386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:35.766597 13386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:35.767555 13386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:35.769088 13386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:35.769200 13386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:35.769337 13386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:35.769434 13386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:35.800899 13386 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.66:46775
I20260806 20:36:35.800925 13574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.66:46775 every 8 connection(s)
I20260806 20:36:35.802232 13386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/data/info.pb
I20260806 20:36:35.803745 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 13386
I20260806 20:36:35.803969 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal/instance
I20260806 20:36:35.804436 13909 external_mini_cluster.cc:1428] Setting key 9949efd707c9a598aa12afc0752c83ce
I20260806 20:36:35.807888 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.149.67:0
--local_ip_for_outbound_sockets=127.13.149.67
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38831
--builtin_ntp_servers=127.13.149.84:33681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 20:36:35.817457 13383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:35.804988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:52897 (local address 127.13.149.126:38831)
0806 20:36:35.805171 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:35.805175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:35.806813 (+ 1638us) server_negotiation.cc:407] Connection header received
0806 20:36:35.809568 (+ 2755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:35.809572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:35.809644 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:35.809734 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:35.811128 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.811850 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.814313 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.814833 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.814970 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:35.816576 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:35.816581 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:35.816584 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:35.816602 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:35.816633 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:35.816646 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:35.816716 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:35.817025 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 20:36:35.817131 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 20:36:35.818810 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:35.805622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38831 (local address 127.13.149.66:52897)
0806 20:36:35.806655 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:35.806692 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:35.809243 (+ 2551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:35.809991 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:35.810005 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:35.810128 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:35.810945 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:35.810971 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.812025 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.812033 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:35.814125 (+ 2092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:35.814169 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:35.815103 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:35.815113 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:35.815449 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:35.816212 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:35.816218 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:35.816271 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:35.816378 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:35.816749 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:35.816763 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:35.816774 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 20:36:35.816984 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 20:36:35.817403 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":306,"threads_started":1}
I20260806 20:36:35.820272 13575 heartbeater.cc:347] Connected to a master server at 127.13.149.126:38831
I20260806 20:36:35.820616 13575 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:35.821472 13575 heartbeater.cc:511] Master 127.13.149.126:38831 requested a full tablet report, sending...
I20260806 20:36:35.823315 13104 ts_manager.cc:194] Registered new tserver with Master: e31bace7b79442efbaa3137a809d9f95 (127.13.149.66:46775)
I20260806 20:36:35.824499 13104 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.66:52897
W20260806 20:36:36.150343 13578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:36.150693 13578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:36.150875 13578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:36.158224 13578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:36.158313 13578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:36.158524 13578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.149.67
I20260806 20:36:36.167460 13578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:33681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.149.67
--webserver_port=0
--tserver_master_addrs=127.13.149.126:38831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.149.67
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:36.168848 13578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:36.170696 13578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:36.184093 13594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:36.184166 13590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:36.184027 13591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:36.184885 13578 server_base.cc:1034] running on GCE node
I20260806 20:36:36.185514 13578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:36.186465 13578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:36.187698 13578 hybrid_clock.cc:648] HybridClock initialized: now 1786048596187667 us; error 51 us; skew 500 ppm
I20260806 20:36:36.188024 13578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 20:36:36.190276 13578 webserver.cc:460] Webserver started at http://127.13.149.67:34193/ using document root <none> and password file <none>
I20260806 20:36:36.190963 13578 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:36.191094 13578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:36.191419 13578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:36.194267 13578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data/instance:
uuid: "dd092380082f4586892fd032cbf15a9e"
format_stamp: "Formatted at 2026-08-06 20:36:36 on dist-test-slave-2kcd"
server_key: "0698077d2ec01ed6dfc548b6bce925ef"
server_key_iv: "dbc9f0975caa245e6d62bef5f57616cd"
server_key_version: "encryptionkey@0"
I20260806 20:36:36.195042 13578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance:
uuid: "dd092380082f4586892fd032cbf15a9e"
format_stamp: "Formatted at 2026-08-06 20:36:36 on dist-test-slave-2kcd"
server_key: "0698077d2ec01ed6dfc548b6bce925ef"
server_key_iv: "dbc9f0975caa245e6d62bef5f57616cd"
server_key_version: "encryptionkey@0"
I20260806 20:36:36.200214 13578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 20:36:36.203675 13602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:36.205106 13578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:36:36.205291 13578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal
uuid: "dd092380082f4586892fd032cbf15a9e"
format_stamp: "Formatted at 2026-08-06 20:36:36 on dist-test-slave-2kcd"
server_key: "0698077d2ec01ed6dfc548b6bce925ef"
server_key_iv: "dbc9f0975caa245e6d62bef5f57616cd"
server_key_version: "encryptionkey@0"
I20260806 20:36:36.205502 13578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:36.220670 13578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:36.221555 13578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:36.221874 13578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:36.222868 13578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 20:36:36.224371 13578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 20:36:36.224464 13578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:36.224617 13578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 20:36:36.224713 13578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:36.269970 13578 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.67:43657
I20260806 20:36:36.270051 13785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.67:43657 every 8 connection(s)
I20260806 20:36:36.271838 13578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/data/info.pb
I20260806 20:36:36.276172 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 13578
I20260806 20:36:36.276371 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal/instance
I20260806 20:36:36.277004 13909 external_mini_cluster.cc:1428] Setting key 2cb22d5704ea34fcf5ef629c96c30fc5
I20260806 20:36:36.288280 13383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.275646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.67:50069 (local address 127.13.149.126:38831)
0806 20:36:36.275884 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.275893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.276749 (+ 856us) server_negotiation.cc:407] Connection header received
0806 20:36:36.279224 (+ 2475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.279230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.279314 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.279440 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:36.280988 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.282263 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.284942 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.285700 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.285873 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.287281 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:36.287290 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:36.287298 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:36.287336 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:36.287382 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:36.287403 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:36.287500 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.287843 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.287943 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:36:36.289397 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.275488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38831 (local address 127.13.149.67:50069)
0806 20:36:36.276604 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:36.276640 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:36.278879 (+ 2239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:36.279695 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:36.279705 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:36.279823 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:36:36.280728 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.280757 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.282459 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.282468 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.284741 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.284772 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.286000 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.286007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.286206 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.286956 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 20:36:36.286958 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:36:36.286996 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 20:36:36.287068 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:36:36.287563 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:36:36.287575 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:36:36.287587 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 20:36:36.287805 (+ 218us) client_negotiation.cc:240] Negotiation successful
0806 20:36:36.288173 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":363,"threads_started":1}
I20260806 20:36:36.290663 13786 heartbeater.cc:347] Connected to a master server at 127.13.149.126:38831
I20260806 20:36:36.290993 13786 heartbeater.cc:464] Registering TS with master...
I20260806 20:36:36.291913 13786 heartbeater.cc:511] Master 127.13.149.126:38831 requested a full tablet report, sending...
I20260806 20:36:36.293314 13104 ts_manager.cc:194] Registered new tserver with Master: dd092380082f4586892fd032cbf15a9e (127.13.149.67:43657)
I20260806 20:36:36.294158 13104 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.149.67:50069
I20260806 20:36:36.304659 13909 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 20:36:36.314461 13383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.308829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42914 (local address 127.13.149.126:38831)
0806 20:36:36.309004 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.309009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.309477 (+ 468us) server_negotiation.cc:407] Connection header received
0806 20:36:36.309672 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.309677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.309747 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.309885 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:36.310395 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.311066 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.312364 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.312756 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.312916 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.313905 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:36.313910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:36.313913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:36.313930 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:36.313961 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:36.313972 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:36.314047 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.314162 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.314230 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 20:36:36.318071 13104 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 20:36:36.324774 13104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 20:36:36.356760 13381 heartbeater.cc:503] Master 127.13.149.126:38831 was elected leader, sending a full tablet report...
I20260806 20:36:36.358891 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.337382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43657 (local address 127.0.0.1:39482)
0806 20:36:36.349025 (+ 11643us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:36.349043 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:36.349163 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:36.350055 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:36.350062 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:36.350094 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:36.350486 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.350501 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.353410 (+ 2909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.353418 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.355353 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.355387 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.357927 (+ 2540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.357933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.358148 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.358206 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 20:36:36.358337 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 20:36:36.358565 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11467,"thread_start_us":11327,"threads_started":1}
I20260806 20:36:36.359170 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.338107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39482 (local address 127.13.149.67:43657)
0806 20:36:36.349310 (+ 11203us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.349323 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.349369 (+ 46us) server_negotiation.cc:407] Connection header received
0806 20:36:36.349503 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.349514 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.349824 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.350042 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:36.351175 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.353287 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.355597 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.357707 (+ 2110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.357853 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.358145 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.358595 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.358772 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10984,"thread_start_us":11038,"threads_started":1}
I20260806 20:36:36.360105 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.338061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.66:46775 (local address 127.0.0.1:52508)
0806 20:36:36.351070 (+ 13009us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:36.351090 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:36.351195 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:36.351922 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:36.351929 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:36.351956 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:36.352447 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.352457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.354588 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.354592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.357042 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.357058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.359247 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.359256 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.359449 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.359480 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 20:36:36.359577 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 20:36:36.359700 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12883,"mutex_wait_us":52,"spinlock_wait_cycles":1792,"thread_start_us":10014,"threads_started":1}
I20260806 20:36:36.360693 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.338707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52508 (local address 127.13.149.66:46775)
0806 20:36:36.351187 (+ 12480us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.351203 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.351236 (+ 33us) server_negotiation.cc:407] Connection header received
0806 20:36:36.351340 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.351350 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.351589 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.351820 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:36.352775 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.354389 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.357282 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.358757 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.358900 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.359110 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.359646 (+ 536us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.359832 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12215,"thread_start_us":12104,"threads_started":1}
I20260806 20:36:36.360895 13804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.337091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33815 (local address 127.0.0.1:57244)
0806 20:36:36.347576 (+ 10485us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:36.347630 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:36.347856 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:36.351940 (+ 4084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:36.351943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:36.351984 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:36.352427 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.352441 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.354543 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.354549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.357403 (+ 2854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.357416 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.360064 (+ 2648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.360073 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.360265 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.360308 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 20:36:36.360369 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 20:36:36.360519 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10124,"mutex_wait_us":112,"spinlock_wait_cycles":1280,"thread_start_us":13759,"threads_started":1}
I20260806 20:36:36.361732 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.337441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57244 (local address 127.13.149.65:33815)
0806 20:36:36.351302 (+ 13861us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.351310 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.351341 (+ 31us) server_negotiation.cc:407] Connection header received
0806 20:36:36.351431 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.351436 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.351622 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.352561 (+ 939us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:36.352847 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.354388 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.358367 (+ 3979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.359828 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.360758 (+ 930us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.361195 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.361272 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.361472 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13103,"thread_start_us":12968,"threads_started":1}
I20260806 20:36:36.364420 13484 tablet_service.cc:1467] Processing CreateTablet for tablet b279b37f61964b5db9a2554c319e297b (DEFAULT_TABLE table=test-table [id=2a59c317a5b14c16a3b81bb81f4b6a90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:36.364360 13682 tablet_service.cc:1467] Processing CreateTablet for tablet b279b37f61964b5db9a2554c319e297b (DEFAULT_TABLE table=test-table [id=2a59c317a5b14c16a3b81bb81f4b6a90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:36.365703 13484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b279b37f61964b5db9a2554c319e297b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:36.365196 13290 tablet_service.cc:1467] Processing CreateTablet for tablet b279b37f61964b5db9a2554c319e297b (DEFAULT_TABLE table=test-table [id=2a59c317a5b14c16a3b81bb81f4b6a90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 20:36:36.365895 13682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b279b37f61964b5db9a2554c319e297b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:36.366559 13290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b279b37f61964b5db9a2554c319e297b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:36.378050 13814 tablet_bootstrap.cc:492] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Bootstrap starting.
I20260806 20:36:36.381220 13817 tablet_bootstrap.cc:492] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Bootstrap starting.
I20260806 20:36:36.381584 13814 tablet_bootstrap.cc:654] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:36.383013 13814 log.cc:824] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:36.383713 13816 tablet_bootstrap.cc:492] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Bootstrap starting.
I20260806 20:36:36.385000 13817 tablet_bootstrap.cc:654] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:36.386495 13816 tablet_bootstrap.cc:654] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:36.386466 13817 log.cc:824] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:36.387658 13816 log.cc:824] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:36.389971 13817 tablet_bootstrap.cc:492] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: No bootstrap required, opened a new log
I20260806 20:36:36.389993 13814 tablet_bootstrap.cc:492] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: No bootstrap required, opened a new log
I20260806 20:36:36.390270 13814 ts_tablet_manager.cc:1397] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20260806 20:36:36.390313 13817 ts_tablet_manager.cc:1397] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260806 20:36:36.390694 13816 tablet_bootstrap.cc:492] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: No bootstrap required, opened a new log
I20260806 20:36:36.390969 13816 ts_tablet_manager.cc:1397] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 20:36:36.397419 13814 raft_consensus.cc:348] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.397810 13814 raft_consensus.cc:374] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:36.397904 13814 raft_consensus.cc:729] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e31bace7b79442efbaa3137a809d9f95, State: Initialized, Role: FOLLOWER
I20260806 20:36:36.398578 13814 consensus_queue.cc:260] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.400480 13814 ts_tablet_manager.cc:1428] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20260806 20:36:36.401342 13575 heartbeater.cc:503] Master 127.13.149.126:38831 was elected leader, sending a full tablet report...
I20260806 20:36:36.401072 13817 raft_consensus.cc:348] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.401533 13817 raft_consensus.cc:374] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:36.401636 13817 raft_consensus.cc:729] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd092380082f4586892fd032cbf15a9e, State: Initialized, Role: FOLLOWER
I20260806 20:36:36.401451 13816 raft_consensus.cc:348] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.401871 13816 raft_consensus.cc:374] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:36.401981 13816 raft_consensus.cc:729] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc6b649bb2c24a19a6f2c9817f15dc06, State: Initialized, Role: FOLLOWER
I20260806 20:36:36.402272 13817 consensus_queue.cc:260] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.402541 13816 consensus_queue.cc:260] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.406227 13817 ts_tablet_manager.cc:1428] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Time spent starting tablet: real 0.016s user 0.011s sys 0.003s
I20260806 20:36:36.406267 13786 heartbeater.cc:503] Master 127.13.149.126:38831 was elected leader, sending a full tablet report...
I20260806 20:36:36.406692 13816 ts_tablet_manager.cc:1428] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260806 20:36:36.483184 13821 raft_consensus.cc:482] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 20:36:36.483615 13821 raft_consensus.cc:504] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.485656 13821 leader_election.cc:288] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc6b649bb2c24a19a6f2c9817f15dc06 (127.13.149.65:33815), dd092380082f4586892fd032cbf15a9e (127.13.149.67:43657)
I20260806 20:36:36.493234 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.486250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:33303 (local address 127.13.149.67:43657)
0806 20:36:36.486522 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.486532 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.487421 (+ 889us) server_negotiation.cc:407] Connection header received
0806 20:36:36.487633 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.487637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.487694 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.487799 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:36.488591 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.489349 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.491426 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.492159 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.492317 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.492395 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.492850 (+ 455us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.492975 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 20:36:36.493285 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.486174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.149.66:52891 (local address 127.13.149.65:33815)
0806 20:36:36.486424 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.486432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.487350 (+ 918us) server_negotiation.cc:407] Connection header received
0806 20:36:36.487572 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.487578 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.487682 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.487785 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 20:36:36.488417 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.489297 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.491369 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.492184 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.492402 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.492480 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.492871 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.493006 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 20:36:36.493338 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.485914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.65:33815 (local address 127.13.149.66:52891)
0806 20:36:36.487203 (+ 1289us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:36.487223 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:36.487388 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:36.487815 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:36.487820 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:36.487843 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:36.488237 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.488250 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.489458 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.489463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.491150 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.491163 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.492425 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.492433 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.492620 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.492659 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 20:36:36.492735 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 20:36:36.492913 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1134,"mutex_wait_us":111,"thread_start_us":725,"threads_started":1}
I20260806 20:36:36.493650 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.486194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.67:43657 (local address 127.13.149.66:33303)
0806 20:36:36.487256 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0806 20:36:36.487293 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 20:36:36.487475 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:36:36.487845 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:36:36.487850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:36:36.487874 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 20:36:36.488402 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.488414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.489523 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.489527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.491187 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:36:36.491211 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.492371 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.492380 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:36:36.492621 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.492663 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 20:36:36.492836 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 20:36:36.492975 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954,"mutex_wait_us":65,"thread_start_us":672,"threads_started":1}
I20260806 20:36:36.494577 13316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b279b37f61964b5db9a2554c319e297b" candidate_uuid: "e31bace7b79442efbaa3137a809d9f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" is_pre_election: true
I20260806 20:36:36.494729 13710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b279b37f61964b5db9a2554c319e297b" candidate_uuid: "e31bace7b79442efbaa3137a809d9f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd092380082f4586892fd032cbf15a9e" is_pre_election: true
I20260806 20:36:36.495126 13316 raft_consensus.cc:2454] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e31bace7b79442efbaa3137a809d9f95 in term 0.
I20260806 20:36:36.495323 13710 raft_consensus.cc:2454] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e31bace7b79442efbaa3137a809d9f95 in term 0.
I20260806 20:36:36.495837 13410 leader_election.cc:302] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc6b649bb2c24a19a6f2c9817f15dc06, e31bace7b79442efbaa3137a809d9f95; no voters:
I20260806 20:36:36.496268 13821 raft_consensus.cc:2781] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 20:36:36.496444 13821 raft_consensus.cc:482] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 20:36:36.496572 13821 raft_consensus.cc:3037] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:36.498991 13821 raft_consensus.cc:504] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.499681 13821 leader_election.cc:288] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [CANDIDATE]: Term 1 election: Requested vote from peers dc6b649bb2c24a19a6f2c9817f15dc06 (127.13.149.65:33815), dd092380082f4586892fd032cbf15a9e (127.13.149.67:43657)
I20260806 20:36:36.500103 13316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b279b37f61964b5db9a2554c319e297b" candidate_uuid: "e31bace7b79442efbaa3137a809d9f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06"
I20260806 20:36:36.500229 13710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b279b37f61964b5db9a2554c319e297b" candidate_uuid: "e31bace7b79442efbaa3137a809d9f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd092380082f4586892fd032cbf15a9e"
I20260806 20:36:36.500337 13316 raft_consensus.cc:3037] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:36.500447 13710 raft_consensus.cc:3037] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:36.503820 13710 raft_consensus.cc:2454] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e31bace7b79442efbaa3137a809d9f95 in term 1.
I20260806 20:36:36.503834 13316 raft_consensus.cc:2454] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e31bace7b79442efbaa3137a809d9f95 in term 1.
I20260806 20:36:36.504276 13412 leader_election.cc:302] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd092380082f4586892fd032cbf15a9e, e31bace7b79442efbaa3137a809d9f95; no voters:
I20260806 20:36:36.504707 13821 raft_consensus.cc:2781] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:36.505201 13821 raft_consensus.cc:686] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 1 LEADER]: Becoming Leader. State: Replica: e31bace7b79442efbaa3137a809d9f95, State: Running, Role: LEADER
I20260806 20:36:36.505714 13821 consensus_queue.cc:237] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } }
I20260806 20:36:36.510991 13104 catalog_manager.cc:5495] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 reported cstate change: term changed from 0 to 1, leader changed from <none> to e31bace7b79442efbaa3137a809d9f95 (127.13.149.66). New cstate: current_term: 1 leader_uuid: "e31bace7b79442efbaa3137a809d9f95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e31bace7b79442efbaa3137a809d9f95" member_type: VOTER last_known_addr { host: "127.13.149.66" port: 46775 } health_report { overall_health: HEALTHY } } }
W20260806 20:36:36.523671 13787 tablet.cc:2369] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:36.553265 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.547553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.13.149.66:46775)
0806 20:36:36.547766 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.547773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.547890 (+ 117us) server_negotiation.cc:407] Connection header received
0806 20:36:36.548138 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.548142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.548235 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.548397 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:36:36.548841 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.549572 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.551021 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.551442 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.551593 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.552093 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:36:36.552585 (+ 492us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:36:36.552718 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.552901 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.552967 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 20:36:36.554419 13576 tablet.cc:2369] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:36:36.561772 13710 raft_consensus.cc:1261] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 1 FOLLOWER]: Refusing update from remote peer e31bace7b79442efbaa3137a809d9f95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:36.561964 13316 raft_consensus.cc:1261] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 1 FOLLOWER]: Refusing update from remote peer e31bace7b79442efbaa3137a809d9f95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:36:36.563035 13831 consensus_queue.cc:1035] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc6b649bb2c24a19a6f2c9817f15dc06" member_type: VOTER last_known_addr { host: "127.13.149.65" port: 33815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:36.563431 13821 consensus_queue.cc:1035] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd092380082f4586892fd032cbf15a9e" member_type: VOTER last_known_addr { host: "127.13.149.67" port: 43657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:36:36.576897 13836 mvcc.cc:205] Tried to move back new op lower bound from 7315655051507105792 to 7315655051291607040. Current Snapshot: MvccSnapshot[applied={T|T < 7315655051507105792}]
I20260806 20:36:36.589593 13104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:36.589895 13104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 20:36:36.593686 13104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 53ba68e88c654a2ca7fab99cece2cbf9: Sending DeleteTablet for 3 replicas of tablet b279b37f61964b5db9a2554c319e297b
I20260806 20:36:36.594856 13290 tablet_service.cc:1514] Processing DeleteTablet for tablet b279b37f61964b5db9a2554c319e297b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:36 UTC) from {username='slave'} at 127.0.0.1:57244
I20260806 20:36:36.595055 13484 tablet_service.cc:1514] Processing DeleteTablet for tablet b279b37f61964b5db9a2554c319e297b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:36 UTC) from {username='slave'} at 127.0.0.1:52508
I20260806 20:36:36.595202 13682 tablet_service.cc:1514] Processing DeleteTablet for tablet b279b37f61964b5db9a2554c319e297b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 20:36:36 UTC) from {username='slave'} at 127.0.0.1:39482
I20260806 20:36:36.596467 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 13196
I20260806 20:36:36.610553 13847 tablet_replica.cc:330] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: stopping tablet replica
I20260806 20:36:36.611195 13847 raft_consensus.cc:2229] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:36.611816 13847 raft_consensus.cc:2258] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:36.613300 13849 tablet_replica.cc:330] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: stopping tablet replica
I20260806 20:36:36.613549 13848 tablet_replica.cc:330] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: stopping tablet replica
I20260806 20:36:36.613691 13849 raft_consensus.cc:2229] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 20:36:36.613941 13848 raft_consensus.cc:2229] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 1 LEADER]: Raft consensus shutting down.
I20260806 20:36:36.614183 13849 raft_consensus.cc:2258] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:36.614598 13848 raft_consensus.cc:2258] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 20:36:36.615226 13847 ts_tablet_manager.cc:1905] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:36.616614 13848 ts_tablet_manager.cc:1905] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:36.623020 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.598699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57260 (local address 127.13.149.65:33815)
0806 20:36:36.598914 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.598923 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.612613 (+ 13690us) server_negotiation.cc:407] Connection header received
0806 20:36:36.613132 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.613138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.613241 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.613348 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:36.615077 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.616174 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.618064 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.618744 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.618860 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.621143 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:36.621156 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:36.621172 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:36.621928 (+ 756us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:36.621983 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:36.622009 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:36.622098 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.622353 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.622477 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 20:36:36.624400 13849 ts_tablet_manager.cc:1905] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 20:36:36.625536 13848 ts_tablet_manager.cc:1918] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:36.625720 13848 log.cc:1196] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-1/wal/wals/b279b37f61964b5db9a2554c319e297b
I20260806 20:36:36.626267 13848 ts_tablet_manager.cc:1939] T b279b37f61964b5db9a2554c319e297b P e31bace7b79442efbaa3137a809d9f95: Deleting consensus metadata
I20260806 20:36:36.628473 13082 catalog_manager.cc:4841] TS e31bace7b79442efbaa3137a809d9f95 (127.13.149.66:46775): tablet b279b37f61964b5db9a2554c319e297b (table test-table [id=2a59c317a5b14c16a3b81bb81f4b6a90]) successfully deleted
I20260806 20:36:36.628525 13847 ts_tablet_manager.cc:1918] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:36.628717 13847 log.cc:1196] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-0/wal/wals/b279b37f61964b5db9a2554c319e297b
I20260806 20:36:36.629344 13847 ts_tablet_manager.cc:1939] T b279b37f61964b5db9a2554c319e297b P dc6b649bb2c24a19a6f2c9817f15dc06: Deleting consensus metadata
I20260806 20:36:36.629411 13374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:36.631917 13849 ts_tablet_manager.cc:1918] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 20:36:36.632117 13849 log.cc:1196] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Deleting WAL directory at /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786048265930148-13909-0/minicluster-data/ts-2/wal/wals/b279b37f61964b5db9a2554c319e297b
I20260806 20:36:36.632746 13849 ts_tablet_manager.cc:1939] T b279b37f61964b5db9a2554c319e297b P dd092380082f4586892fd032cbf15a9e: Deleting consensus metadata
I20260806 20:36:36.635229 13084 catalog_manager.cc:4841] TS dd092380082f4586892fd032cbf15a9e (127.13.149.67:43657): tablet b279b37f61964b5db9a2554c319e297b (table test-table [id=2a59c317a5b14c16a3b81bb81f4b6a90]) successfully deleted
I20260806 20:36:36.742908 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 13196
I20260806 20:36:36.742981 13083 catalog_manager.cc:4841] TS dc6b649bb2c24a19a6f2c9817f15dc06 (127.13.149.65:33815): tablet b279b37f61964b5db9a2554c319e297b (table test-table [id=2a59c317a5b14c16a3b81bb81f4b6a90]) successfully deleted
I20260806 20:36:36.770116 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 13386
I20260806 20:36:36.777707 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.770949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.13.149.66:46775)
0806 20:36:36.771176 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.771182 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.771207 (+ 25us) server_negotiation.cc:407] Connection header received
0806 20:36:36.771416 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.771422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.771518 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.771637 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:36.772044 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.772907 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.774196 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.774759 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.774927 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.776047 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:36.776056 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:36.776071 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:36.776707 (+ 636us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:36.776755 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:36.776775 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:36.777078 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.777230 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.777352 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 20:36:36.778532 13567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:36.897900 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 13386
I20260806 20:36:36.924921 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 13578
I20260806 20:36:36.931663 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:36.925734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.13.149.67:43657)
0806 20:36:36.925960 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:36.925965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:36.925984 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:36:36.926145 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:36.926149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:36.926231 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:36.926316 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:36.926658 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.927377 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.928661 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:36.929213 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:36.929318 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:36.930316 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:36.930324 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:36.930339 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:36.930938 (+ 599us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:36.930985 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:36.931005 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:36.931092 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:36.931218 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 20:36:36.931303 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 20:36:36.932336 13776 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:37.022014 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 13578
I20260806 20:36:37.046862 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 13057
I20260806 20:36:37.048175 13155 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:37.160080 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 13057
2026-08-06T20:36:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3004 ms)
[----------] 6 tests from EncryptionPolicyTest (23709 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:37 dist-test-slave-2kcd krb5kdc[13862](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:37 dist-test-slave-2kcd krb5kdc[13862](info): set up 2 sockets
Aug 06 20:36:37 dist-test-slave-2kcd krb5kdc[13862](info): commencing operation
krb5kdc: starting...
W20260806 20:36:38.505457 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:38 dist-test-slave-2kcd krb5kdc[13862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:38.833088 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36269
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:39.173805 13883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:39.174100 13883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:39.174264 13883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:39.182152 13883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:39.182305 13883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:39.182403 13883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:39.182504 13883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:39.182576 13883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:39.192513 13883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36269
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:39.193892 13883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:39.195212 13883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:39.207348 13893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:39.207419 13892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:39.207612 13897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:39.208068 13883 server_base.cc:1034] running on GCE node
I20260806 20:36:39.208918 13883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:39.210317 13883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:39.211529 13883 hybrid_clock.cc:648] HybridClock initialized: now 1786048599211468 us; error 50 us; skew 500 ppm
I20260806 20:36:39.211918 13883 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:39 dist-test-slave-2kcd krb5kdc[13862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048599, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:39.220033 13883 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:39.221612 13883 webserver.cc:460] Webserver started at http://127.0.0.1:45911/ using document root <none> and password file <none>
I20260806 20:36:39.222275 13883 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:39.222381 13883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:39.222632 13883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:39.225755 13883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "911ddb3a1ea04d688892ae54720c0092"
format_stamp: "Formatted at 2026-08-06 20:36:39 on dist-test-slave-2kcd"
server_key: "a9a5721f5eca38a623ab71d1eef8abda"
server_key_iv: "f5401605fcbd83fdcd6db14471803822"
server_key_version: "encryptionkey@0"
I20260806 20:36:39.226493 13883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "911ddb3a1ea04d688892ae54720c0092"
format_stamp: "Formatted at 2026-08-06 20:36:39 on dist-test-slave-2kcd"
server_key: "a9a5721f5eca38a623ab71d1eef8abda"
server_key_iv: "f5401605fcbd83fdcd6db14471803822"
server_key_version: "encryptionkey@0"
I20260806 20:36:39.231592 13883 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:36:39.235126 13920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:39.236480 13883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 20:36:39.236682 13883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "911ddb3a1ea04d688892ae54720c0092"
format_stamp: "Formatted at 2026-08-06 20:36:39 on dist-test-slave-2kcd"
server_key: "a9a5721f5eca38a623ab71d1eef8abda"
server_key_iv: "f5401605fcbd83fdcd6db14471803822"
server_key_version: "encryptionkey@0"
I20260806 20:36:39.236989 13883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:39.261864 13883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:39.265854 13883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:39.266152 13883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:39.284809 13883 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36269
I20260806 20:36:39.284899 14001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36269 every 8 connection(s)
I20260806 20:36:39.286223 13883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:39.289885 14002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:39.294282 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 13883
I20260806 20:36:39.294507 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:39.295408 13909 external_mini_cluster.cc:1428] Setting key 838f583574e0128c09815bfbc4d281f0
I20260806 20:36:39.300554 14002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092: Bootstrap starting.
I20260806 20:36:39.303630 14002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:39.304643 14002 log.cc:824] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:39.307389 14002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092: No bootstrap required, opened a new log
Aug 06 20:36:39 dist-test-slave-2kcd krb5kdc[13862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 20:36:39.315444 14002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911ddb3a1ea04d688892ae54720c0092" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36269 } }
I20260806 20:36:39.315824 14002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:39.315950 14002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911ddb3a1ea04d688892ae54720c0092, State: Initialized, Role: FOLLOWER
I20260806 20:36:39.316649 14002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911ddb3a1ea04d688892ae54720c0092" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36269 } }
I20260806 20:36:39.316956 14002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:39.317112 14002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:39.317332 14002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:39.318259 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:39.297398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41439 (local address 127.0.0.1:36269)
0806 20:36:39.298243 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:39.298255 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:39.298298 (+ 43us) server_negotiation.cc:407] Connection header received
0806 20:36:39.300021 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:39.300050 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:39.300419 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:39.300778 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:39.302288 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:39.303605 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:39.304950 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:39.305634 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:39.305870 (+ 236us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:39.310016 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:39.310025 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:39.310038 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:39.310072 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:39.313421 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:39.314306 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:39.314313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:39.314319 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:39.314503 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:39.314990 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:39.314994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:39.314996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:39.315487 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:39.315867 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:39.316354 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 20:36:39.316706 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":390,"threads_started":1}
I20260806 20:36:39.320442 14002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911ddb3a1ea04d688892ae54720c0092" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36269 } }
I20260806 20:36:39.321049 14002 leader_election.cc:302] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 911ddb3a1ea04d688892ae54720c0092; no voters:
I20260806 20:36:39.321844 14002 leader_election.cc:288] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:39.321957 14008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:39.322520 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:39.324445 14002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:39.325088 14008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [term 1 LEADER]: Becoming Leader. State: Replica: 911ddb3a1ea04d688892ae54720c0092, State: Running, Role: LEADER
I20260806 20:36:39.325687 14008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911ddb3a1ea04d688892ae54720c0092" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36269 } }
I20260806 20:36:39.329805 14010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911ddb3a1ea04d688892ae54720c0092. Latest consensus state: current_term: 1 leader_uuid: "911ddb3a1ea04d688892ae54720c0092" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911ddb3a1ea04d688892ae54720c0092" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36269 } } }
I20260806 20:36:39.329846 14009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "911ddb3a1ea04d688892ae54720c0092" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911ddb3a1ea04d688892ae54720c0092" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36269 } } }
I20260806 20:36:39.330364 14010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:39.330368 14009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:39.345358 14022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:39.347884 14038 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 20:36:39.351091 14022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:39.356941 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:39.329460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59145 (local address 127.0.0.1:36269)
0806 20:36:39.329697 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:39.329706 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:39.341205 (+ 11499us) server_negotiation.cc:407] Connection header received
0806 20:36:39.341441 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:39.341447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:39.341528 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:39.341656 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:39.343557 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:39.345018 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:39.346342 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:39.346813 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:39.346984 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:39.350020 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:39.350032 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:39.350036 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:39.350065 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:39.353636 (+ 3571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:39.354454 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:39.354459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:39.354463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:39.354595 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:39.355149 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:39.355155 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:39.355159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:39.355586 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:39.355874 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:39.356341 (+ 467us) server_negotiation.cc:299] Negotiation successful
0806 20:36:39.356538 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 20:36:39.360515 14022 catalog_manager.cc:1347] Generated new cluster ID: 8d2a4454093d43dbbfafde0b20c75e20
I20260806 20:36:39.360638 14022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:39.371994 14022 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:39.373222 14022 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:39.379631 14022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 911ddb3a1ea04d688892ae54720c0092: Generated new TSK 0
I20260806 20:36:39.380358 14022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:39.387638 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 13883
I20260806 20:36:39.389591 13993 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:39.478082 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 13883
W20260806 20:36:39.502198 13859 connection.cc:535] client connection to 127.0.0.1:36269 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36269): Connection reset by peer (error 104)
2026-08-06T20:36:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2304 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:39 dist-test-slave-2kcd krb5kdc[14047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:39 dist-test-slave-2kcd krb5kdc[14047](info): set up 2 sockets
Aug 06 20:36:39 dist-test-slave-2kcd krb5kdc[14047](info): commencing operation
krb5kdc: starting...
W20260806 20:36:40.827818 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:41 dist-test-slave-2kcd krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:41.147681 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36881
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:41.489387 14068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:41.489671 14068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:41.489776 14068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:41.496949 14068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:41.497051 14068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:41.497105 14068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:41.497167 14068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:41.497211 14068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:41.506826 14068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36881
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:41.508006 14068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:41.509274 14068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:41.520933 14076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:41.520965 14077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:41.520953 14081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:41.522207 14068 server_base.cc:1034] running on GCE node
I20260806 20:36:41.522958 14068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:41.524250 14068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:41.525480 14068 hybrid_clock.cc:648] HybridClock initialized: now 1786048601525427 us; error 56 us; skew 500 ppm
I20260806 20:36:41.525816 14068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:41 dist-test-slave-2kcd krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048601, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:41.529038 14068 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:41.530629 14068 webserver.cc:460] Webserver started at http://127.0.0.1:32823/ using document root <none> and password file <none>
I20260806 20:36:41.531520 14068 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:41.531697 14068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:41.532104 14068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:41.535423 14068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "c9ec3c75526b466fa48dbd998a05ebce"
format_stamp: "Formatted at 2026-08-06 20:36:41 on dist-test-slave-2kcd"
server_key: "0fef64ff5c6e466f9cbad62cef322c1a"
server_key_iv: "e7de89d73e1684e5d4073dec4a9e06d4"
server_key_version: "encryptionkey@0"
I20260806 20:36:41.536185 14068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "c9ec3c75526b466fa48dbd998a05ebce"
format_stamp: "Formatted at 2026-08-06 20:36:41 on dist-test-slave-2kcd"
server_key: "0fef64ff5c6e466f9cbad62cef322c1a"
server_key_iv: "e7de89d73e1684e5d4073dec4a9e06d4"
server_key_version: "encryptionkey@0"
I20260806 20:36:41.541163 14068 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:36:41.544432 14095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:41.545671 14068 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:36:41.545857 14068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "c9ec3c75526b466fa48dbd998a05ebce"
format_stamp: "Formatted at 2026-08-06 20:36:41 on dist-test-slave-2kcd"
server_key: "0fef64ff5c6e466f9cbad62cef322c1a"
server_key_iv: "e7de89d73e1684e5d4073dec4a9e06d4"
server_key_version: "encryptionkey@0"
I20260806 20:36:41.546051 14068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:41.557628 14068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:41.561800 14068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:41.562075 14068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:41.580494 14068 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36881
I20260806 20:36:41.580525 14168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36881 every 8 connection(s)
I20260806 20:36:41.581861 14068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:41.585492 14170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:41.586148 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14068
I20260806 20:36:41.586342 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:41.586987 13909 external_mini_cluster.cc:1428] Setting key 25c54ed576446c45b690fc06c5180630
I20260806 20:36:41.597769 14170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce: Bootstrap starting.
I20260806 20:36:41.600036 14176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:41.588839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43879 (local address 127.0.0.1:36881)
0806 20:36:41.589583 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:41.589595 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:41.589640 (+ 45us) server_negotiation.cc:407] Connection header received
0806 20:36:41.591820 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:41.591842 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:41.592209 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:41.592584 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:41.593127 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:41.594340 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:41.595663 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:41.596325 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:41.596506 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:41.597792 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:41.597800 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:41.597812 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:41.598400 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:41.598462 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:41.598486 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:41.598668 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:41.598916 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 20:36:41.599081 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":322,"threads_started":1}
I20260806 20:36:41.601094 14170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:41.602149 14170 log.cc:824] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:41.603834 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:41.605579 14170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce: No bootstrap required, opened a new log
I20260806 20:36:41.614111 14170 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9ec3c75526b466fa48dbd998a05ebce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36881 } }
I20260806 20:36:41.614475 14170 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:41.614595 14170 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ec3c75526b466fa48dbd998a05ebce, State: Initialized, Role: FOLLOWER
I20260806 20:36:41.615207 14176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:41.609269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51931 (local address 127.0.0.1:36881)
0806 20:36:41.609460 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:41.609467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:41.609762 (+ 295us) server_negotiation.cc:407] Connection header received
0806 20:36:41.609951 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:41.609955 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:41.610015 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:41.610113 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:41.610620 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:41.611387 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:41.612680 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:41.613227 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:41.613371 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:41.614476 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:41.614482 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:41.614487 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:41.614511 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:41.614553 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:41.614590 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:41.614695 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:41.614880 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 20:36:41.614932 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 20:36:41.615269 14170 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9ec3c75526b466fa48dbd998a05ebce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36881 } }
I20260806 20:36:41.615574 14170 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:41.615729 14170 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:41.615933 14170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:41.618340 14170 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9ec3c75526b466fa48dbd998a05ebce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36881 } }
I20260806 20:36:41.618830 14170 leader_election.cc:302] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9ec3c75526b466fa48dbd998a05ebce; no voters:
I20260806 20:36:41.619479 14170 leader_election.cc:288] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:41.619614 14188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:41.620301 14188 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [term 1 LEADER]: Becoming Leader. State: Replica: c9ec3c75526b466fa48dbd998a05ebce, State: Running, Role: LEADER
I20260806 20:36:41.620905 14188 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9ec3c75526b466fa48dbd998a05ebce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36881 } }
I20260806 20:36:41.621637 14170 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:41.623440 14191 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9ec3c75526b466fa48dbd998a05ebce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9ec3c75526b466fa48dbd998a05ebce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36881 } } }
I20260806 20:36:41.623871 14191 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:41.630697 14192 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9ec3c75526b466fa48dbd998a05ebce. Latest consensus state: current_term: 1 leader_uuid: "c9ec3c75526b466fa48dbd998a05ebce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9ec3c75526b466fa48dbd998a05ebce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36881 } } }
I20260806 20:36:41.631132 14192 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:41.631889 14199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:41.637629 14199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:41.646039 14199 catalog_manager.cc:1347] Generated new cluster ID: cf2b4332fcef4de88d7a3e4565bf926c
I20260806 20:36:41.646149 14199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:41.655216 14199 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:41.656364 14199 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:41.664953 14199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9ec3c75526b466fa48dbd998a05ebce: Generated new TSK 0
I20260806 20:36:41.665647 14199 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:41.675164 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14068
W20260806 20:36:41.676254 14163 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43879
W20260806 20:36:41.677237 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14068: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:36:41.677453 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14068
W20260806 20:36:41.704962 14043 connection.cc:535] client connection to 127.0.0.1:36881 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36881): Connection reset by peer (error 104)
2026-08-06T20:36:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2202 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:41 dist-test-slave-2kcd krb5kdc[14221](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:41 dist-test-slave-2kcd krb5kdc[14221](info): set up 2 sockets
Aug 06 20:36:41 dist-test-slave-2kcd krb5kdc[14221](info): commencing operation
krb5kdc: starting...
W20260806 20:36:43.021512 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:43 dist-test-slave-2kcd krb5kdc[14221](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:43.345803 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42125
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:43.690738 14241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:43.691016 14241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:43.691175 14241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:43.698184 14241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:43.698289 14241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:43.698375 14241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:43.698477 14241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:43.698557 14241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:43.708001 14241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42125
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:43.709324 14241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:43.710644 14241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:43.722796 14248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:43.722935 14249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:43.722965 14254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:43.723882 14241 server_base.cc:1034] running on GCE node
I20260806 20:36:43.724737 14241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:43.726177 14241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:43.727416 14241 hybrid_clock.cc:648] HybridClock initialized: now 1786048603727375 us; error 47 us; skew 500 ppm
I20260806 20:36:43.727797 14241 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:43 dist-test-slave-2kcd krb5kdc[14221](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048603, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:43.730940 14241 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:43.732332 14241 webserver.cc:460] Webserver started at http://127.0.0.1:35175/ using document root <none> and password file <none>
I20260806 20:36:43.733037 14241 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:43.733143 14241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:43.733413 14241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:43.736362 14241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20"
format_stamp: "Formatted at 2026-08-06 20:36:43 on dist-test-slave-2kcd"
server_key: "2fdfc38680329e2dd8159f96275b43af"
server_key_iv: "cd37d1bc59fd7faf652b5662e97ac702"
server_key_version: "encryptionkey@0"
I20260806 20:36:43.737147 14241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20"
format_stamp: "Formatted at 2026-08-06 20:36:43 on dist-test-slave-2kcd"
server_key: "2fdfc38680329e2dd8159f96275b43af"
server_key_iv: "cd37d1bc59fd7faf652b5662e97ac702"
server_key_version: "encryptionkey@0"
I20260806 20:36:43.742313 14241 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 20:36:43.745662 14269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:43.746927 14241 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:36:43.747068 14241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20"
format_stamp: "Formatted at 2026-08-06 20:36:43 on dist-test-slave-2kcd"
server_key: "2fdfc38680329e2dd8159f96275b43af"
server_key_iv: "cd37d1bc59fd7faf652b5662e97ac702"
server_key_version: "encryptionkey@0"
I20260806 20:36:43.747244 14241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:43.752702 14241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:43.756600 14241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:43.756958 14241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:43.775359 14241 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42125
I20260806 20:36:43.775388 14341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42125 every 8 connection(s)
I20260806 20:36:43.776693 14241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:43.780439 14342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:43.785645 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14241
I20260806 20:36:43.785817 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:43.786301 13909 external_mini_cluster.cc:1428] Setting key 05f5e9acaa18b407f23fb5bc0d716985
I20260806 20:36:43.791121 14342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20: Bootstrap starting.
I20260806 20:36:43.794003 14348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:43.788056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49009 (local address 127.0.0.1:42125)
0806 20:36:43.788997 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:43.789008 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:43.789053 (+ 45us) server_negotiation.cc:407] Connection header received
0806 20:36:43.790714 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:43.790736 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:43.791048 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:43.791392 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:43.792446 (+ 1054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:43.792453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:43.792465 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:43.792479 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:43.792534 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:43.792553 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:43.792724 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:43.792936 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 20:36:43.793148 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":401,"threads_started":1}
I20260806 20:36:43.794704 14342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:43.796129 14342 log.cc:824] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:43.797812 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:43.799285 14342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20: No bootstrap required, opened a new log
I20260806 20:36:43.805598 14348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:43.803016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40665 (local address 127.0.0.1:42125)
0806 20:36:43.803201 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:43.803206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:43.803493 (+ 287us) server_negotiation.cc:407] Connection header received
0806 20:36:43.803620 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:43.803627 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:43.803689 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:43.803795 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:43.804906 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:43.804912 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:43.804917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:43.804935 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:43.804990 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:43.805010 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:43.805128 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:43.805237 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 20:36:43.805301 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 20:36:43.808889 14342 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42125 } }
I20260806 20:36:43.809247 14342 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:43.809353 14342 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6cd035c5c9d4396bbb2612c7ed7cb20, State: Initialized, Role: FOLLOWER
I20260806 20:36:43.809885 14342 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42125 } }
I20260806 20:36:43.810128 14342 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:43.810276 14342 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:43.810458 14342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:43.813254 14342 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42125 } }
I20260806 20:36:43.813750 14342 leader_election.cc:302] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6cd035c5c9d4396bbb2612c7ed7cb20; no voters:
I20260806 20:36:43.814301 14342 leader_election.cc:288] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:43.814440 14361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:43.815167 14361 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [term 1 LEADER]: Becoming Leader. State: Replica: b6cd035c5c9d4396bbb2612c7ed7cb20, State: Running, Role: LEADER
I20260806 20:36:43.815743 14361 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42125 } }
I20260806 20:36:43.816411 14342 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:43.818738 14362 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42125 } } }
I20260806 20:36:43.819269 14362 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:43.819087 14363 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6cd035c5c9d4396bbb2612c7ed7cb20. Latest consensus state: current_term: 1 leader_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cd035c5c9d4396bbb2612c7ed7cb20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42125 } } }
I20260806 20:36:43.819407 14363 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:43.821657 14369 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:43.827080 14369 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:43.836504 14369 catalog_manager.cc:1347] Generated new cluster ID: dd0d89f3b52647f7b20da953fa9b5197
I20260806 20:36:43.836633 14369 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:43.873975 14369 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:43.874421 14369 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:43.884024 14369 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6cd035c5c9d4396bbb2612c7ed7cb20: Generated new TSK 0
I20260806 20:36:43.884903 14369 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:43.892282 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14241
W20260806 20:36:43.893918 14334 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49009
W20260806 20:36:43.894655 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14241: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:36:43.894819 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14241
2026-08-06T20:36:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2215 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:44 dist-test-slave-2kcd krb5kdc[14397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:44 dist-test-slave-2kcd krb5kdc[14397](info): set up 2 sockets
Aug 06 20:36:44 dist-test-slave-2kcd krb5kdc[14397](info): commencing operation
krb5kdc: starting...
W20260806 20:36:45.275684 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:45 dist-test-slave-2kcd krb5kdc[14397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:45.603380 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37639
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:45.951309 14420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:45.951700 14420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:45.951902 14420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:45.959378 14420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:45.959559 14420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:45.959668 14420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:45.959793 14420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:45.959883 14420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:45.970928 14420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:45.972344 14420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:45.973779 14420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:45.986100 14431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:45.986183 14434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:45.986140 14430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:45.987246 14420 server_base.cc:1034] running on GCE node
I20260806 20:36:45.987982 14420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:45.989418 14420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:45.990653 14420 hybrid_clock.cc:648] HybridClock initialized: now 1786048605990613 us; error 28 us; skew 500 ppm
I20260806 20:36:45.991034 14420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:45 dist-test-slave-2kcd krb5kdc[14397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048605, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:45.998091 14420 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:45.999671 14420 webserver.cc:460] Webserver started at http://127.0.0.1:44413/ using document root <none> and password file <none>
I20260806 20:36:46.000358 14420 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:46.000507 14420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:46.000857 14420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:46.003858 14420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "4ca2988c8b1e4a87a55ea848408aa163"
format_stamp: "Formatted at 2026-08-06 20:36:45 on dist-test-slave-2kcd"
server_key: "4085d22b7f2165832ff1e7de917ff84d"
server_key_iv: "6407202ae33f431ce3a261be93c4079a"
server_key_version: "encryptionkey@0"
I20260806 20:36:46.004640 14420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "4ca2988c8b1e4a87a55ea848408aa163"
format_stamp: "Formatted at 2026-08-06 20:36:45 on dist-test-slave-2kcd"
server_key: "4085d22b7f2165832ff1e7de917ff84d"
server_key_iv: "6407202ae33f431ce3a261be93c4079a"
server_key_version: "encryptionkey@0"
I20260806 20:36:46.009799 14420 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 20:36:46.013207 14445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:46.014497 14420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:36:46.014678 14420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "4ca2988c8b1e4a87a55ea848408aa163"
format_stamp: "Formatted at 2026-08-06 20:36:45 on dist-test-slave-2kcd"
server_key: "4085d22b7f2165832ff1e7de917ff84d"
server_key_iv: "6407202ae33f431ce3a261be93c4079a"
server_key_version: "encryptionkey@0"
I20260806 20:36:46.014863 14420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:46.028939 14420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:46.032716 14420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:46.033036 14420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:46.051388 14420 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37639
I20260806 20:36:46.051419 14523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37639 every 8 connection(s)
I20260806 20:36:46.052670 14420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:46.054790 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14420
I20260806 20:36:46.054986 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:46.055572 13909 external_mini_cluster.cc:1428] Setting key 6aaff801550b4fa905dbcdf4bb55d267
I20260806 20:36:46.057054 14524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:46.068200 14524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163: Bootstrap starting.
Aug 06 20:36:46 dist-test-slave-2kcd krb5kdc[14397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 20:36:46.071586 14524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:46.072674 14524 log.cc:824] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:46.076105 14524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163: No bootstrap required, opened a new log
I20260806 20:36:46.077131 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:46.057323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58279 (local address 127.0.0.1:37639)
0806 20:36:46.058102 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:46.058113 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:46.058152 (+ 39us) server_negotiation.cc:407] Connection header received
0806 20:36:46.059718 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:46.059738 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:46.060110 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:46.060488 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:46.062021 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:46.063331 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:46.064546 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:46.065284 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:46.065487 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:46.069659 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:46.069671 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:46.069685 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:46.069725 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:46.072749 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:46.073686 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:46.073697 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:46.073710 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:46.073951 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:46.074454 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:46.074457 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:46.074459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:46.074954 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:46.075185 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:46.075684 (+ 499us) server_negotiation.cc:299] Negotiation successful
0806 20:36:46.076025 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":339,"threads_started":1}
I20260806 20:36:46.080689 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:46.085688 14524 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca2988c8b1e4a87a55ea848408aa163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37639 } }
I20260806 20:36:46.086261 14524 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:46.086376 14524 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca2988c8b1e4a87a55ea848408aa163, State: Initialized, Role: FOLLOWER
I20260806 20:36:46.087010 14524 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca2988c8b1e4a87a55ea848408aa163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37639 } }
I20260806 20:36:46.087332 14524 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:46.087482 14524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:46.087673 14524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:46.090654 14524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca2988c8b1e4a87a55ea848408aa163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37639 } }
I20260806 20:36:46.091212 14524 leader_election.cc:302] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ca2988c8b1e4a87a55ea848408aa163; no voters:
I20260806 20:36:46.091923 14524 leader_election.cc:288] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:46.092075 14541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:46.093070 14541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [term 1 LEADER]: Becoming Leader. State: Replica: 4ca2988c8b1e4a87a55ea848408aa163, State: Running, Role: LEADER
I20260806 20:36:46.093715 14541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca2988c8b1e4a87a55ea848408aa163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37639 } }
I20260806 20:36:46.094574 14524 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:46.096083 14542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ca2988c8b1e4a87a55ea848408aa163. Latest consensus state: current_term: 1 leader_uuid: "4ca2988c8b1e4a87a55ea848408aa163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca2988c8b1e4a87a55ea848408aa163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37639 } } }
I20260806 20:36:46.097502 14542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:46.097597 14543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ca2988c8b1e4a87a55ea848408aa163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca2988c8b1e4a87a55ea848408aa163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37639 } } }
I20260806 20:36:46.097910 14543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:46.098994 14550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:46.104753 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:46.085931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38557 (local address 127.0.0.1:37639)
0806 20:36:46.086159 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:46.086165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:46.086551 (+ 386us) server_negotiation.cc:407] Connection header received
0806 20:36:46.086769 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:46.086778 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:46.086855 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:46.086932 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:46.089003 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:46.089729 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:46.091486 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:46.091984 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:46.092132 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:46.094832 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:46.094841 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:46.094847 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:46.094884 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:46.099521 (+ 4637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:46.100593 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:46.100601 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:46.100607 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:46.100861 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:46.101486 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:46.101494 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:46.101500 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:46.101966 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:46.103665 (+ 1699us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:46.103850 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 20:36:46.104159 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:36:46.109418 14550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:46.118911 14550 catalog_manager.cc:1347] Generated new cluster ID: 518007924c82453eb577ae3fadaf986b
I20260806 20:36:46.119053 14550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:46.138610 14550 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:46.139936 14550 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:46.157426 14550 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ca2988c8b1e4a87a55ea848408aa163: Generated new TSK 0
I20260806 20:36:46.158470 14550 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:46.166517 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14420
I20260806 20:36:46.167716 14518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:46.263517 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14420
2026-08-06T20:36:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2367 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:46 dist-test-slave-2kcd krb5kdc[14568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:46 dist-test-slave-2kcd krb5kdc[14568](info): set up 2 sockets
Aug 06 20:36:46 dist-test-slave-2kcd krb5kdc[14568](info): commencing operation
krb5kdc: starting...
W20260806 20:36:47.623466 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:47 dist-test-slave-2kcd krb5kdc[14568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:47.934348 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42073
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:48.286464 14587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:48.286763 14587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:48.286970 14587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:48.294196 14587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:48.294334 14587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:48.294456 14587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:48.294564 14587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:48.294637 14587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:48.304513 14587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:48.305920 14587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:48.307343 14587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:48.319844 14592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:48.319927 14593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:48.319953 14595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:48.321290 14587 server_base.cc:1034] running on GCE node
I20260806 20:36:48.322142 14587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:48.323642 14587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:48.324882 14587 hybrid_clock.cc:648] HybridClock initialized: now 1786048608324834 us; error 58 us; skew 500 ppm
I20260806 20:36:48.325330 14587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:48 dist-test-slave-2kcd krb5kdc[14568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048608, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:48.328740 14587 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:48.330242 14587 webserver.cc:460] Webserver started at http://127.0.0.1:40829/ using document root <none> and password file <none>
I20260806 20:36:48.330999 14587 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:48.331121 14587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:48.331380 14587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:48.334474 14587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "ff49aecc9cbc40bc84f0921da0b894df"
format_stamp: "Formatted at 2026-08-06 20:36:48 on dist-test-slave-2kcd"
server_key: "054dd158f6b631919891b0d38b2c7247"
server_key_iv: "4d72360fa081ce587ed824565628cd2e"
server_key_version: "encryptionkey@0"
I20260806 20:36:48.335175 14587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "ff49aecc9cbc40bc84f0921da0b894df"
format_stamp: "Formatted at 2026-08-06 20:36:48 on dist-test-slave-2kcd"
server_key: "054dd158f6b631919891b0d38b2c7247"
server_key_iv: "4d72360fa081ce587ed824565628cd2e"
server_key_version: "encryptionkey@0"
I20260806 20:36:48.340581 14587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:36:48.344132 14607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:48.345669 14587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:36:48.345813 14587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "ff49aecc9cbc40bc84f0921da0b894df"
format_stamp: "Formatted at 2026-08-06 20:36:48 on dist-test-slave-2kcd"
server_key: "054dd158f6b631919891b0d38b2c7247"
server_key_iv: "4d72360fa081ce587ed824565628cd2e"
server_key_version: "encryptionkey@0"
I20260806 20:36:48.346009 14587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:48.365146 14587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:48.369638 14587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:48.369902 14587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:48.388249 14587 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42073
I20260806 20:36:48.388286 14684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42073 every 8 connection(s)
I20260806 20:36:48.389665 14587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:48.393438 14685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:48.396719 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14587
I20260806 20:36:48.396953 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:48.397397 13909 external_mini_cluster.cc:1428] Setting key 2f67fb72dc9c1bbbb2bb9af9a106586d
I20260806 20:36:48.404840 14685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df: Bootstrap starting.
I20260806 20:36:48.407939 14685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:48.409174 14685 log.cc:824] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:48.410323 14691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:48.399128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57747 (local address 127.0.0.1:42073)
0806 20:36:48.399899 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:48.399911 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:48.399951 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:36:48.401638 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:48.401659 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:48.402049 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:48.402424 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:48.402983 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:48.404200 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:48.405648 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:48.406327 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:48.406550 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:48.407672 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:48.407679 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:48.407692 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:48.408284 (+ 592us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:48.408384 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:48.408415 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:48.408534 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:48.408770 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 20:36:48.409041 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":345,"threads_started":1}
I20260806 20:36:48.412326 14685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df: No bootstrap required, opened a new log
I20260806 20:36:48.414103 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:48.422904 14685 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff49aecc9cbc40bc84f0921da0b894df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42073 } }
I20260806 20:36:48.423367 14685 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:48.423511 14685 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff49aecc9cbc40bc84f0921da0b894df, State: Initialized, Role: FOLLOWER
I20260806 20:36:48.424239 14685 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff49aecc9cbc40bc84f0921da0b894df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42073 } }
I20260806 20:36:48.424537 14685 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:48.424695 14685 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:48.424932 14685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:48.426111 14691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:48.419283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41957 (local address 127.0.0.1:42073)
0806 20:36:48.419494 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:48.419503 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:48.419969 (+ 466us) server_negotiation.cc:407] Connection header received
0806 20:36:48.420148 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:48.420153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:48.420211 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:48.420291 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:48.420941 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:48.421669 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:48.423522 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:48.424012 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:48.424116 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:48.425313 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:48.425317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:48.425320 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:48.425337 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:48.425390 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:48.425404 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:48.425476 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:48.425675 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 20:36:48.425749 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 20:36:48.428010 14685 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff49aecc9cbc40bc84f0921da0b894df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42073 } }
I20260806 20:36:48.428511 14685 leader_election.cc:302] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff49aecc9cbc40bc84f0921da0b894df; no voters:
I20260806 20:36:48.429205 14685 leader_election.cc:288] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:48.429332 14701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:48.430085 14701 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [term 1 LEADER]: Becoming Leader. State: Replica: ff49aecc9cbc40bc84f0921da0b894df, State: Running, Role: LEADER
I20260806 20:36:48.430693 14701 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff49aecc9cbc40bc84f0921da0b894df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42073 } }
I20260806 20:36:48.431380 14685 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:48.433823 14706 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff49aecc9cbc40bc84f0921da0b894df. Latest consensus state: current_term: 1 leader_uuid: "ff49aecc9cbc40bc84f0921da0b894df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff49aecc9cbc40bc84f0921da0b894df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42073 } } }
I20260806 20:36:48.434315 14706 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:48.434926 14703 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff49aecc9cbc40bc84f0921da0b894df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff49aecc9cbc40bc84f0921da0b894df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42073 } } }
I20260806 20:36:48.435284 14703 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:48.435318 14714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:48.441463 14714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:48.450934 14714 catalog_manager.cc:1347] Generated new cluster ID: 5818b898ace54ad596cf7880998f9bd8
I20260806 20:36:48.451074 14714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:48.462067 14714 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:48.463881 14714 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:48.476611 14714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff49aecc9cbc40bc84f0921da0b894df: Generated new TSK 0
I20260806 20:36:48.477607 14714 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:48.483253 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14587
W20260806 20:36:48.484587 14679 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57747
W20260806 20:36:48.485390 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14587: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:36:48.485560 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14587
2026-08-06T20:36:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2223 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:48 dist-test-slave-2kcd krb5kdc[14730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:48 dist-test-slave-2kcd krb5kdc[14730](info): set up 2 sockets
Aug 06 20:36:48 dist-test-slave-2kcd krb5kdc[14730](info): commencing operation
krb5kdc: starting...
W20260806 20:36:49.841137 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.002s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:50 dist-test-slave-2kcd krb5kdc[14730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:50.133714 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45807
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:50.484113 14753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:50.484473 14753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:50.484642 14753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:50.491926 14753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:50.492084 14753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:50.492197 14753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:50.492311 14753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:50.492399 14753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:50.502599 14753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:50.504055 14753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:50.505479 14753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:50.517581 14760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:50.517585 14766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:50.517619 14764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:50.518575 14753 server_base.cc:1034] running on GCE node
I20260806 20:36:50.519346 14753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:50.520678 14753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:50.521905 14753 hybrid_clock.cc:648] HybridClock initialized: now 1786048610521859 us; error 36 us; skew 500 ppm
I20260806 20:36:50.522221 14753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:50 dist-test-slave-2kcd krb5kdc[14730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048610, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:50.525257 14753 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:50.526683 14753 webserver.cc:460] Webserver started at http://127.0.0.1:42199/ using document root <none> and password file <none>
I20260806 20:36:50.527328 14753 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:50.527432 14753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:50.527698 14753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:50.530736 14753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "a20bb9eb78524857a4c4cb7a825e7dae"
format_stamp: "Formatted at 2026-08-06 20:36:50 on dist-test-slave-2kcd"
server_key: "c8740582de5fb67680342fb9d854c921"
server_key_iv: "1dbba9026e51dc579f834efe2c4282fc"
server_key_version: "encryptionkey@0"
I20260806 20:36:50.531458 14753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "a20bb9eb78524857a4c4cb7a825e7dae"
format_stamp: "Formatted at 2026-08-06 20:36:50 on dist-test-slave-2kcd"
server_key: "c8740582de5fb67680342fb9d854c921"
server_key_iv: "1dbba9026e51dc579f834efe2c4282fc"
server_key_version: "encryptionkey@0"
I20260806 20:36:50.536621 14753 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 20:36:50.540207 14779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:50.541584 14753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:36:50.541718 14753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "a20bb9eb78524857a4c4cb7a825e7dae"
format_stamp: "Formatted at 2026-08-06 20:36:50 on dist-test-slave-2kcd"
server_key: "c8740582de5fb67680342fb9d854c921"
server_key_iv: "1dbba9026e51dc579f834efe2c4282fc"
server_key_version: "encryptionkey@0"
I20260806 20:36:50.541877 14753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:50.547436 14753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:50.551316 14753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:50.551566 14753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:50.578656 14753 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45807
I20260806 20:36:50.578691 14858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45807 every 8 connection(s)
I20260806 20:36:50.580101 14753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:50.583829 14859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:50.589332 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14753
I20260806 20:36:50.589527 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:50.589972 13909 external_mini_cluster.cc:1428] Setting key e25e2fa8f4759c5caa1e0593f27ee30b
I20260806 20:36:50.595969 14859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae: Bootstrap starting.
I20260806 20:36:50.599187 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:50.591841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54589 (local address 127.0.0.1:45807)
0806 20:36:50.592747 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:50.592767 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:50.592853 (+ 86us) server_negotiation.cc:407] Connection header received
0806 20:36:50.595261 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:50.595288 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:50.595728 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:50.596164 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:50.597174 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:50.597184 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:50.597200 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:50.597218 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:50.597290 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:50.597319 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:50.597559 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:50.597717 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 20:36:50.597926 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":366,"threads_started":1}
I20260806 20:36:50.599992 14859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:50.601161 14859 log.cc:824] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:50.602950 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:50.604148 14859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae: No bootstrap required, opened a new log
I20260806 20:36:50.610577 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:50.608470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55933 (local address 127.0.0.1:45807)
0806 20:36:50.608674 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:50.608679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:50.608697 (+ 18us) server_negotiation.cc:407] Connection header received
0806 20:36:50.608749 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:50.608752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:50.608845 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:50.608973 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:50.609908 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:50.609914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:50.609918 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:50.609936 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:50.609981 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:50.609996 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:50.610130 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:50.610252 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 20:36:50.610314 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 20:36:50.612602 14859 raft_consensus.cc:348] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45807 } }
I20260806 20:36:50.613031 14859 raft_consensus.cc:374] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:50.613150 14859 raft_consensus.cc:729] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a20bb9eb78524857a4c4cb7a825e7dae, State: Initialized, Role: FOLLOWER
I20260806 20:36:50.613711 14859 consensus_queue.cc:260] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45807 } }
I20260806 20:36:50.613994 14859 raft_consensus.cc:388] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:50.614147 14859 raft_consensus.cc:482] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:50.614333 14859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:50.616855 14859 raft_consensus.cc:504] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45807 } }
I20260806 20:36:50.617473 14859 leader_election.cc:302] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a20bb9eb78524857a4c4cb7a825e7dae; no voters:
I20260806 20:36:50.618001 14859 leader_election.cc:288] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:50.618162 14872 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:50.618917 14872 raft_consensus.cc:686] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [term 1 LEADER]: Becoming Leader. State: Replica: a20bb9eb78524857a4c4cb7a825e7dae, State: Running, Role: LEADER
I20260806 20:36:50.619477 14872 consensus_queue.cc:237] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45807 } }
I20260806 20:36:50.620199 14859 sys_catalog.cc:564] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:50.622444 14876 sys_catalog.cc:455] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [sys.catalog]: SysCatalogTable state changed. Reason: New leader a20bb9eb78524857a4c4cb7a825e7dae. Latest consensus state: current_term: 1 leader_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45807 } } }
I20260806 20:36:50.622965 14876 sys_catalog.cc:458] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:50.622807 14874 sys_catalog.cc:455] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a20bb9eb78524857a4c4cb7a825e7dae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45807 } } }
I20260806 20:36:50.623251 14874 sys_catalog.cc:458] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:50.625469 14883 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:50.630504 14883 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:50.641275 14883 catalog_manager.cc:1347] Generated new cluster ID: 8b912392e7fc40fca26f193f33d8e9d7
I20260806 20:36:50.641390 14883 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:50.671116 14883 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:50.671581 14883 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:50.678155 14883 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a20bb9eb78524857a4c4cb7a825e7dae: Generated new TSK 0
I20260806 20:36:50.678963 14883 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:50.685355 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14753
W20260806 20:36:50.686472 14853 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54589
W20260806 20:36:50.687219 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14753: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:36:50.687376 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14753
2026-08-06T20:36:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2199 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:50 dist-test-slave-2kcd krb5kdc[14909](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:50 dist-test-slave-2kcd krb5kdc[14909](info): set up 2 sockets
Aug 06 20:36:50 dist-test-slave-2kcd krb5kdc[14909](info): commencing operation
krb5kdc: starting...
W20260806 20:36:52.027999 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:52 dist-test-slave-2kcd krb5kdc[14909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:52.340137 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33359
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:52.686161 14928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:52.686427 14928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:52.686618 14928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:52.693642 14928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:52.693770 14928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:52.693910 14928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:52.694026 14928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:52.694113 14928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:52.703506 14928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:52.704797 14928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:52.706102 14928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:52.717885 14933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:52.718050 14936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:52.718235 14934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:52.719094 14928 server_base.cc:1034] running on GCE node
I20260806 20:36:52.719805 14928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:52.721230 14928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:52.722421 14928 hybrid_clock.cc:648] HybridClock initialized: now 1786048612722377 us; error 50 us; skew 500 ppm
I20260806 20:36:52.722783 14928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:52 dist-test-slave-2kcd krb5kdc[14909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048612, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:52.729868 14928 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:52.731364 14928 webserver.cc:460] Webserver started at http://127.0.0.1:39661/ using document root <none> and password file <none>
I20260806 20:36:52.732064 14928 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:52.732218 14928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:52.732534 14928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:52.735617 14928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "a5ca85e1e0634bd5950d1d1d52dafcac"
format_stamp: "Formatted at 2026-08-06 20:36:52 on dist-test-slave-2kcd"
server_key: "5d9041f58bd021fee88b5d0e15fcb9d6"
server_key_iv: "e7b359e6b822f1a6d3ee8781f0192edf"
server_key_version: "encryptionkey@0"
I20260806 20:36:52.736400 14928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "a5ca85e1e0634bd5950d1d1d52dafcac"
format_stamp: "Formatted at 2026-08-06 20:36:52 on dist-test-slave-2kcd"
server_key: "5d9041f58bd021fee88b5d0e15fcb9d6"
server_key_iv: "e7b359e6b822f1a6d3ee8781f0192edf"
server_key_version: "encryptionkey@0"
I20260806 20:36:52.741700 14928 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260806 20:36:52.745285 14948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:52.746591 14928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:36:52.746785 14928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "a5ca85e1e0634bd5950d1d1d52dafcac"
format_stamp: "Formatted at 2026-08-06 20:36:52 on dist-test-slave-2kcd"
server_key: "5d9041f58bd021fee88b5d0e15fcb9d6"
server_key_iv: "e7b359e6b822f1a6d3ee8781f0192edf"
server_key_version: "encryptionkey@0"
I20260806 20:36:52.746980 14928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:52.797731 14928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:52.802030 14928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:52.802343 14928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:52.821293 14928 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33359
I20260806 20:36:52.821331 15026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33359 every 8 connection(s)
I20260806 20:36:52.822715 14928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:52.826555 15027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:52.830869 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 14928
I20260806 20:36:52.831069 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:52.831512 13909 external_mini_cluster.cc:1428] Setting key 77ba6bdfa1fa0bd4c2a177243fd693fc
I20260806 20:36:52.839232 15027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac: Bootstrap starting.
I20260806 20:36:52.843007 15027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:52.844321 15027 log.cc:824] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:52.847352 15027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac: No bootstrap required, opened a new log
Aug 06 20:36:52 dist-test-slave-2kcd krb5kdc[14909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 20:36:52.858681 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:52.833594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:56841 (local address 127.0.0.1:33359)
0806 20:36:52.834386 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:52.834403 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:52.834462 (+ 59us) server_negotiation.cc:407] Connection header received
0806 20:36:52.837482 (+ 3020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:52.837511 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:52.838043 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:52.838478 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:52.840012 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:52.842105 (+ 2093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:52.843512 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:52.844580 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:52.844815 (+ 235us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:52.849310 (+ 4495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:52.849322 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:52.849350 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:52.849415 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:52.853802 (+ 4387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:52.854634 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:52.854643 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:52.854652 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:52.854878 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:52.855333 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:52.855338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:52.855342 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:52.856109 (+ 767us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:52.856456 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:52.856835 (+ 379us) server_negotiation.cc:299] Negotiation successful
0806 20:36:52.857224 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":336,"threads_started":1}
I20260806 20:36:52.858517 15027 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33359 } }
I20260806 20:36:52.858989 15027 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:52.859115 15027 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5ca85e1e0634bd5950d1d1d52dafcac, State: Initialized, Role: FOLLOWER
I20260806 20:36:52.859819 15027 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33359 } }
I20260806 20:36:52.860136 15027 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:52.860319 15027 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:52.860546 15027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:52.863049 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:52.863521 15027 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33359 } }
I20260806 20:36:52.864013 15027 leader_election.cc:302] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5ca85e1e0634bd5950d1d1d52dafcac; no voters:
I20260806 20:36:52.864737 15027 leader_election.cc:288] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:52.864882 15036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:52.867385 15027 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:52.868160 15036 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [term 1 LEADER]: Becoming Leader. State: Replica: a5ca85e1e0634bd5950d1d1d52dafcac, State: Running, Role: LEADER
I20260806 20:36:52.869323 15036 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33359 } }
I20260806 20:36:52.872573 15038 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5ca85e1e0634bd5950d1d1d52dafcac. Latest consensus state: current_term: 1 leader_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33359 } } }
I20260806 20:36:52.872967 15038 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:52.872996 15037 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5ca85e1e0634bd5950d1d1d52dafcac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33359 } } }
I20260806 20:36:52.873292 15037 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:52.881224 15049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:52.886744 15049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:52.890784 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:52.868696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:34837 (local address 127.0.0.1:33359)
0806 20:36:52.868950 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:52.868958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:52.868987 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:36:52.869146 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:52.869152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:52.869232 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:52.869347 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:52.870935 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:52.872340 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:52.874731 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:52.875572 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:52.875735 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:52.880095 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:52.880105 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:52.880113 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:52.880167 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:52.885178 (+ 5011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:52.886571 (+ 1393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:52.886580 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:52.886586 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:52.886777 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:52.887520 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:52.887527 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:52.887536 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:52.888139 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:52.888477 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:52.889969 (+ 1492us) server_negotiation.cc:299] Negotiation successful
0806 20:36:52.890227 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 20:36:52.898371 15049 catalog_manager.cc:1347] Generated new cluster ID: aab14bac36a14bcdb73f00b86e9c7ddc
I20260806 20:36:52.898506 15049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:52.909838 15049 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:52.911168 15049 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:52.919314 15049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5ca85e1e0634bd5950d1d1d52dafcac: Generated new TSK 0
I20260806 20:36:52.920153 15049 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:52.927002 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 14928
I20260806 20:36:52.928515 15022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:53.019001 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 14928
W20260806 20:36:53.045053 14906 connection.cc:535] client connection to 127.0.0.1:33359 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33359): Connection reset by peer (error 104)
2026-08-06T20:36:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2334 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:53 dist-test-slave-2kcd krb5kdc[15071](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:53 dist-test-slave-2kcd krb5kdc[15071](info): set up 2 sockets
Aug 06 20:36:53 dist-test-slave-2kcd krb5kdc[15071](info): commencing operation
krb5kdc: starting...
W20260806 20:36:54.360546 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.001s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:54 dist-test-slave-2kcd krb5kdc[15071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048614, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:54.679822 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:55.022135 15088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:55.022432 15088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:55.022533 15088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:55.029747 15088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:55.029876 15088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:55.029940 15088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:55.030014 15088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:55.030066 15088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:55.039947 15088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:55.041258 15088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:55.042622 15088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:55.054689 15095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:55.054741 15099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:55.054782 15096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:55.055987 15088 server_base.cc:1034] running on GCE node
I20260806 20:36:55.056849 15088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:55.058177 15088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:55.059384 15088 hybrid_clock.cc:648] HybridClock initialized: now 1786048615059343 us; error 36 us; skew 500 ppm
I20260806 20:36:55.059751 15088 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:55 dist-test-slave-2kcd krb5kdc[15071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048615, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:55.063083 15088 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:55.064457 15088 webserver.cc:460] Webserver started at http://127.0.0.1:37563/ using document root <none> and password file <none>
I20260806 20:36:55.065152 15088 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:55.065260 15088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:55.065513 15088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:55.068321 15088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "edc8c5ecc3f8466588cdcb02139bfc70"
format_stamp: "Formatted at 2026-08-06 20:36:55 on dist-test-slave-2kcd"
server_key: "bd7b1be5ecb9e8ce0a762118162fa8c3"
server_key_iv: "ea8cbedb8d8685826a41ff29e968a916"
server_key_version: "encryptionkey@0"
I20260806 20:36:55.069113 15088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "edc8c5ecc3f8466588cdcb02139bfc70"
format_stamp: "Formatted at 2026-08-06 20:36:55 on dist-test-slave-2kcd"
server_key: "bd7b1be5ecb9e8ce0a762118162fa8c3"
server_key_iv: "ea8cbedb8d8685826a41ff29e968a916"
server_key_version: "encryptionkey@0"
I20260806 20:36:55.074075 15088 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 20:36:55.077354 15117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:55.078615 15088 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:36:55.078804 15088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "edc8c5ecc3f8466588cdcb02139bfc70"
format_stamp: "Formatted at 2026-08-06 20:36:55 on dist-test-slave-2kcd"
server_key: "bd7b1be5ecb9e8ce0a762118162fa8c3"
server_key_iv: "ea8cbedb8d8685826a41ff29e968a916"
server_key_version: "encryptionkey@0"
I20260806 20:36:55.078990 15088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:55.090533 15088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:55.094228 15088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:55.094503 15088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:55.112637 15088 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34317
I20260806 20:36:55.112668 15203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34317 every 8 connection(s)
I20260806 20:36:55.113968 15088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:55.117605 15204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:55.120728 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15088
I20260806 20:36:55.120947 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:55.121393 13909 external_mini_cluster.cc:1428] Setting key 975131cfc693c2e4205c0b323c0582e9
I20260806 20:36:55.129452 15204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70: Bootstrap starting.
I20260806 20:36:55.133100 15204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:55.134243 15204 log.cc:824] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:55.134639 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:55.123141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:53751 (local address 127.0.0.1:34317)
0806 20:36:55.123862 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:55.123874 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:55.123913 (+ 39us) server_negotiation.cc:407] Connection header received
0806 20:36:55.125592 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:55.125613 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:55.125992 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:55.126310 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:55.126923 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:55.128233 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:55.130127 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:55.130754 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:55.130893 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:55.132245 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:55.132252 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:55.132264 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:55.132765 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:55.132911 (+ 146us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:55.132937 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:55.133067 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:55.133438 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 20:36:55.133635 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":324,"threads_started":1}
I20260806 20:36:55.137535 15204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70: No bootstrap required, opened a new log
I20260806 20:36:55.138911 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:55.148047 15204 raft_consensus.cc:348] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260806 20:36:55.148550 15204 raft_consensus.cc:374] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:55.148748 15204 raft_consensus.cc:729] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc8c5ecc3f8466588cdcb02139bfc70, State: Initialized, Role: FOLLOWER
I20260806 20:36:55.149475 15204 consensus_queue.cc:260] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260806 20:36:55.149775 15204 raft_consensus.cc:388] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:55.149956 15204 raft_consensus.cc:482] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:55.150158 15204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:55.151413 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:55.144236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:54911 (local address 127.0.0.1:34317)
0806 20:36:55.144389 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:55.144394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:55.145000 (+ 606us) server_negotiation.cc:407] Connection header received
0806 20:36:55.145184 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:55.145188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:55.145246 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:55.145323 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:55.145920 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:55.146661 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:55.148612 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:55.149280 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:55.149409 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:55.150620 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:55.150626 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:55.150631 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:55.150652 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:55.150700 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:55.150723 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:55.150854 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:55.151016 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 20:36:55.151068 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 20:36:55.153404 15204 raft_consensus.cc:504] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260806 20:36:55.153903 15204 leader_election.cc:302] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edc8c5ecc3f8466588cdcb02139bfc70; no voters:
I20260806 20:36:55.154517 15204 leader_election.cc:288] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:55.154667 15217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:55.155359 15217 raft_consensus.cc:686] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [term 1 LEADER]: Becoming Leader. State: Replica: edc8c5ecc3f8466588cdcb02139bfc70, State: Running, Role: LEADER
I20260806 20:36:55.155977 15217 consensus_queue.cc:237] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } }
I20260806 20:36:55.156889 15204 sys_catalog.cc:564] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:55.158957 15219 sys_catalog.cc:455] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edc8c5ecc3f8466588cdcb02139bfc70. Latest consensus state: current_term: 1 leader_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } } }
I20260806 20:36:55.159420 15219 sys_catalog.cc:458] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:55.160342 15218 sys_catalog.cc:455] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc8c5ecc3f8466588cdcb02139bfc70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34317 } } }
I20260806 20:36:55.160828 15218 sys_catalog.cc:458] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:55.161209 15226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:55.166736 15226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:55.175973 15226 catalog_manager.cc:1347] Generated new cluster ID: 83bafa4383d34686a0d9e1966edb7279
I20260806 20:36:55.176090 15226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:55.197942 15226 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:55.199218 15226 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:55.210085 15226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edc8c5ecc3f8466588cdcb02139bfc70: Generated new TSK 0
I20260806 20:36:55.210830 15226 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:55.217917 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15088
W20260806 20:36:55.219067 15197 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.94:53751
W20260806 20:36:55.220017 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15088: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:36:55.220208 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15088
W20260806 20:36:55.244944 15067 connection.cc:535] client connection to 127.0.0.1:34317 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34317): Connection reset by peer (error 104)
2026-08-06T20:36:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2199 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:55 dist-test-slave-2kcd krb5kdc[15247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:55 dist-test-slave-2kcd krb5kdc[15247](info): set up 2 sockets
Aug 06 20:36:55 dist-test-slave-2kcd krb5kdc[15247](info): commencing operation
krb5kdc: starting...
W20260806 20:36:56.568449 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:56 dist-test-slave-2kcd krb5kdc[15247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:56.883450 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39541
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:57.232523 15278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:57.232888 15278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:57.233073 15278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:57.240465 15278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:57.240568 15278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:57.240666 15278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:57.240772 15278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:57.240901 15278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:57.250676 15278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:57.251873 15278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:57.253261 15278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:57.265538 15285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:57.265513 15290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:57.265601 15283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:57.272051 15278 server_base.cc:1034] running on GCE node
I20260806 20:36:57.272902 15278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:57.274216 15278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:57.275415 15278 hybrid_clock.cc:648] HybridClock initialized: now 1786048617275355 us; error 59 us; skew 500 ppm
I20260806 20:36:57.275712 15278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:57 dist-test-slave-2kcd krb5kdc[15247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048617, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:57.278985 15278 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:57.280495 15278 webserver.cc:460] Webserver started at http://127.0.0.1:41231/ using document root <none> and password file <none>
I20260806 20:36:57.281235 15278 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:57.281399 15278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:57.281708 15278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:57.284586 15278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "2a181ac8218d40a485a8bb279675c048"
format_stamp: "Formatted at 2026-08-06 20:36:57 on dist-test-slave-2kcd"
server_key: "68792ca2c207b6bd12d70492d0f589bf"
server_key_iv: "d29d284a83c58f16cd243a82d6bcf49d"
server_key_version: "encryptionkey@0"
I20260806 20:36:57.285434 15278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "2a181ac8218d40a485a8bb279675c048"
format_stamp: "Formatted at 2026-08-06 20:36:57 on dist-test-slave-2kcd"
server_key: "68792ca2c207b6bd12d70492d0f589bf"
server_key_iv: "d29d284a83c58f16cd243a82d6bcf49d"
server_key_version: "encryptionkey@0"
I20260806 20:36:57.290300 15278 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 20:36:57.293576 15298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:57.294739 15278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260806 20:36:57.294926 15278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "2a181ac8218d40a485a8bb279675c048"
format_stamp: "Formatted at 2026-08-06 20:36:57 on dist-test-slave-2kcd"
server_key: "68792ca2c207b6bd12d70492d0f589bf"
server_key_iv: "d29d284a83c58f16cd243a82d6bcf49d"
server_key_version: "encryptionkey@0"
I20260806 20:36:57.295121 15278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:57.300669 15278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:57.304524 15278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:57.304847 15278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:57.324352 15278 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39541
I20260806 20:36:57.324430 15373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39541 every 8 connection(s)
I20260806 20:36:57.325664 15278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:57.326668 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15278
I20260806 20:36:57.326869 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:57.327456 13909 external_mini_cluster.cc:1428] Setting key 42530688e82d9c9738fd2eb8fadfa395
I20260806 20:36:57.330161 15374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:36:57.335065 15378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:57.329280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:39653 (local address 127.0.0.1:39541)
0806 20:36:57.330038 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:57.330062 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:57.330097 (+ 35us) server_negotiation.cc:407] Connection header received
0806 20:36:57.331778 (+ 1681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:57.331798 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:57.332094 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:57.332467 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:57.333505 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:57.333511 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:57.333522 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:57.333535 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:57.333616 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:57.333637 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:57.333890 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:57.334036 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 20:36:57.334207 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":328,"threads_started":1}
I20260806 20:36:57.338567 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:57.341166 15374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048: Bootstrap starting.
I20260806 20:36:57.344698 15374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:57.345688 15378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:57.343142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:49829 (local address 127.0.0.1:39541)
0806 20:36:57.343358 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:57.343365 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:57.343567 (+ 202us) server_negotiation.cc:407] Connection header received
0806 20:36:57.343787 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:57.343793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:57.343844 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:57.343967 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:57.345035 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:57.345040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:57.345044 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:36:57.345062 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:57.345102 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:36:57.345117 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:57.345253 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:57.345347 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 20:36:57.345405 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 20:36:57.345975 15374 log.cc:824] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:57.348904 15374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048: No bootstrap required, opened a new log
I20260806 20:36:57.356541 15374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a181ac8218d40a485a8bb279675c048" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39541 } }
I20260806 20:36:57.356927 15374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:57.357034 15374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a181ac8218d40a485a8bb279675c048, State: Initialized, Role: FOLLOWER
I20260806 20:36:57.357626 15374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a181ac8218d40a485a8bb279675c048" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39541 } }
I20260806 20:36:57.357858 15374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:57.358009 15374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:57.358186 15374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:57.360203 15374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a181ac8218d40a485a8bb279675c048" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39541 } }
I20260806 20:36:57.360651 15374 leader_election.cc:302] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a181ac8218d40a485a8bb279675c048; no voters:
I20260806 20:36:57.361347 15374 leader_election.cc:288] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:57.361479 15390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:57.362176 15390 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [term 1 LEADER]: Becoming Leader. State: Replica: 2a181ac8218d40a485a8bb279675c048, State: Running, Role: LEADER
I20260806 20:36:57.362720 15390 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a181ac8218d40a485a8bb279675c048" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39541 } }
I20260806 20:36:57.363529 15374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:57.365631 15395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a181ac8218d40a485a8bb279675c048. Latest consensus state: current_term: 1 leader_uuid: "2a181ac8218d40a485a8bb279675c048" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a181ac8218d40a485a8bb279675c048" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39541 } } }
I20260806 20:36:57.366017 15395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:57.366765 15392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a181ac8218d40a485a8bb279675c048" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a181ac8218d40a485a8bb279675c048" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39541 } } }
I20260806 20:36:57.367115 15392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:57.368235 15401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:57.374475 15401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:57.383179 15401 catalog_manager.cc:1347] Generated new cluster ID: 34be099860d544bcb8e952f212bb3368
I20260806 20:36:57.383291 15401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:57.391314 15401 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:57.391757 15401 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:57.417088 15401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a181ac8218d40a485a8bb279675c048: Generated new TSK 0
I20260806 20:36:57.417961 15401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:57.424443 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15278
W20260806 20:36:57.425659 15366 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.94:39653
W20260806 20:36:57.426362 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15278: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:36:57.426524 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15278
2026-08-06T20:36:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2210 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:57 dist-test-slave-2kcd krb5kdc[15428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:57 dist-test-slave-2kcd krb5kdc[15428](info): set up 2 sockets
Aug 06 20:36:57 dist-test-slave-2kcd krb5kdc[15428](info): commencing operation
krb5kdc: starting...
W20260806 20:36:58.776022 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.002s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:36:58 dist-test-slave-2kcd krb5kdc[15428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:36:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:36:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:36:59.091267 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:36:59.434973 15451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:36:59.435281 15451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:36:59.435403 15451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:36:59.442801 15451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:36:59.442917 15451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:36:59.443029 15451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:36:59.443154 15451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:36:59.443236 15451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:36:59.453397 15451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46375
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:36:59.454751 15451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:36:59.456094 15451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:36:59.468122 15459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:59.468081 15461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:36:59.468158 15458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:36:59.469024 15451 server_base.cc:1034] running on GCE node
I20260806 20:36:59.469835 15451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:36:59.471181 15451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:36:59.472381 15451 hybrid_clock.cc:648] HybridClock initialized: now 1786048619472335 us; error 37 us; skew 500 ppm
I20260806 20:36:59.472733 15451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:36:59 dist-test-slave-2kcd krb5kdc[15428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048619, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:36:59.481565 15451 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:36:59.483191 15451 webserver.cc:460] Webserver started at http://127.0.0.1:33607/ using document root <none> and password file <none>
I20260806 20:36:59.483877 15451 fs_manager.cc:359] Metadata directory not provided
I20260806 20:36:59.484018 15451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:36:59.484350 15451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:36:59.487422 15451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "6db6f6be4c5243bbb20d4b5c66210856"
format_stamp: "Formatted at 2026-08-06 20:36:59 on dist-test-slave-2kcd"
server_key: "c2396ea4c0369fd7d653b1f28674af6d"
server_key_iv: "ae0963cd5d635e2c09eaf5881dd7ce21"
server_key_version: "encryptionkey@0"
I20260806 20:36:59.488209 15451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "6db6f6be4c5243bbb20d4b5c66210856"
format_stamp: "Formatted at 2026-08-06 20:36:59 on dist-test-slave-2kcd"
server_key: "c2396ea4c0369fd7d653b1f28674af6d"
server_key_iv: "ae0963cd5d635e2c09eaf5881dd7ce21"
server_key_version: "encryptionkey@0"
I20260806 20:36:59.493482 15451 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:36:59.496774 15470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:36:59.498144 15451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 20:36:59.498325 15451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "6db6f6be4c5243bbb20d4b5c66210856"
format_stamp: "Formatted at 2026-08-06 20:36:59 on dist-test-slave-2kcd"
server_key: "c2396ea4c0369fd7d653b1f28674af6d"
server_key_iv: "ae0963cd5d635e2c09eaf5881dd7ce21"
server_key_version: "encryptionkey@0"
I20260806 20:36:59.498528 15451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:36:59.518682 15451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:36:59.522464 15451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:36:59.522749 15451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:36:59.541450 15451 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46375
I20260806 20:36:59.541496 15553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46375 every 8 connection(s)
I20260806 20:36:59.542819 15451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:36:59.543793 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15451
I20260806 20:36:59.543995 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:36:59.544574 13909 external_mini_cluster.cc:1428] Setting key e813448eea1cb5fdfc799bd8ac5e8547
I20260806 20:36:59.547472 15554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 20:36:59 dist-test-slave-2kcd krb5kdc[15428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 20:36:59.561424 15554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856: Bootstrap starting.
I20260806 20:36:59.565810 15554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856: Neither blocks nor log segments found. Creating new log.
I20260806 20:36:59.567271 15554 log.cc:824] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856: Log is configured to *not* fsync() on all Append() calls
I20260806 20:36:59.570043 15558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:59.546498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:44697 (local address 127.0.0.1:46375)
0806 20:36:59.547307 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:59.547319 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:59.547361 (+ 42us) server_negotiation.cc:407] Connection header received
0806 20:36:59.549156 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:59.549182 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:59.549539 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:59.549864 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:59.551745 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:59.553170 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:59.555080 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:59.555742 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:59.555879 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:59.560994 (+ 5115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:59.561006 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:59.561029 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:59.561080 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:59.565281 (+ 4201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:59.566235 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:59.566246 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:59.566255 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:59.566493 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:59.566941 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:59.566946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:59.566949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:59.567712 (+ 763us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:59.568119 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:59.568635 (+ 516us) server_negotiation.cc:299] Negotiation successful
0806 20:36:59.569015 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":373,"threads_started":1}
I20260806 20:36:59.570627 15554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856: No bootstrap required, opened a new log
I20260806 20:36:59.574297 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:36:59.579818 15554 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db6f6be4c5243bbb20d4b5c66210856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46375 } }
I20260806 20:36:59.580214 15554 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:36:59.580327 15554 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db6f6be4c5243bbb20d4b5c66210856, State: Initialized, Role: FOLLOWER
I20260806 20:36:59.580981 15554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db6f6be4c5243bbb20d4b5c66210856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46375 } }
I20260806 20:36:59.581228 15554 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:36:59.581386 15554 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:36:59.581609 15554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:36:59.583906 15554 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db6f6be4c5243bbb20d4b5c66210856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46375 } }
I20260806 20:36:59.584450 15554 leader_election.cc:302] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6db6f6be4c5243bbb20d4b5c66210856; no voters:
I20260806 20:36:59.585160 15554 leader_election.cc:288] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:36:59.585304 15569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:36:59.587253 15554 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:36:59.588189 15569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [term 1 LEADER]: Becoming Leader. State: Replica: 6db6f6be4c5243bbb20d4b5c66210856, State: Running, Role: LEADER
I20260806 20:36:59.588899 15569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db6f6be4c5243bbb20d4b5c66210856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46375 } }
I20260806 20:36:59.594897 15570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6db6f6be4c5243bbb20d4b5c66210856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db6f6be4c5243bbb20d4b5c66210856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46375 } } }
I20260806 20:36:59.595459 15570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:59.594960 15571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6db6f6be4c5243bbb20d4b5c66210856. Latest consensus state: current_term: 1 leader_uuid: "6db6f6be4c5243bbb20d4b5c66210856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db6f6be4c5243bbb20d4b5c66210856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46375 } } }
I20260806 20:36:59.595988 15571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856 [sys.catalog]: This master's current role is: LEADER
I20260806 20:36:59.597451 15558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:36:59.578704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:37827 (local address 127.0.0.1:46375)
0806 20:36:59.578920 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 20:36:59.578926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:36:59.579315 (+ 389us) server_negotiation.cc:407] Connection header received
0806 20:36:59.579507 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:36:59.579512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:36:59.579583 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:36:59.579688 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:36:59.581376 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:59.582305 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:59.583532 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:36:59.584063 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:36:59.584212 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:36:59.587916 (+ 3704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:36:59.587922 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:36:59.587927 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:36:59.587966 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:36:59.593137 (+ 5171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:59.594376 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:59.594385 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:59.594392 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:59.594609 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:36:59.595239 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:36:59.595249 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:36:59.595252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:36:59.595757 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:36:59.596097 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0806 20:36:59.596634 (+ 537us) server_negotiation.cc:299] Negotiation successful
0806 20:36:59.596907 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 20:36:59.599834 15591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:36:59.605548 15591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:36:59.619028 15591 catalog_manager.cc:1347] Generated new cluster ID: 0ffe3cc0f4404c9e9f674d0d7b196675
I20260806 20:36:59.619149 15591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:36:59.630177 15591 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:36:59.631518 15591 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:36:59.645284 15591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6db6f6be4c5243bbb20d4b5c66210856: Generated new TSK 0
I20260806 20:36:59.646148 15591 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:36:59.654054 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15451
I20260806 20:36:59.655171 15546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:36:59.746558 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15451
W20260806 20:36:59.772945 15425 connection.cc:535] client connection to 127.0.0.1:46375 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46375): Connection reset by peer (error 104)
2026-08-06T20:36:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2322 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:36:59 dist-test-slave-2kcd krb5kdc[15610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:36:59 dist-test-slave-2kcd krb5kdc[15610](info): set up 2 sockets
Aug 06 20:36:59 dist-test-slave-2kcd krb5kdc[15610](info): commencing operation
krb5kdc: starting...
W20260806 20:37:01.094491 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:01 dist-test-slave-2kcd krb5kdc[15610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:37:01.405463 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:01.748303 15628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:01.748617 15628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:01.748713 15628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:01.755823 15628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:01.755932 15628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:01.755980 15628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:01.756043 15628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:01.756089 15628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:01.765988 15628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37085
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:01.767186 15628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:01.768411 15628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:01.781236 15644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:01.781342 15640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:01.781394 15641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:01.782006 15628 server_base.cc:1034] running on GCE node
I20260806 20:37:01.782739 15628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:01.784051 15628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:01.785290 15628 hybrid_clock.cc:648] HybridClock initialized: now 1786048621785239 us; error 35 us; skew 500 ppm
I20260806 20:37:01.785637 15628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:01 dist-test-slave-2kcd krb5kdc[15610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048621, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:01.788724 15628 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:37:01.790138 15628 webserver.cc:460] Webserver started at http://127.0.0.1:37715/ using document root <none> and password file <none>
I20260806 20:37:01.790794 15628 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:01.790948 15628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:01.791260 15628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:01.794239 15628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "3006a7e054f54b19a86ac0730c39d1af"
format_stamp: "Formatted at 2026-08-06 20:37:01 on dist-test-slave-2kcd"
server_key: "45e14e1d02bb6763a19141709a5569bb"
server_key_iv: "3a610f5205abdba3a5b374dfda3f5b46"
server_key_version: "encryptionkey@0"
I20260806 20:37:01.795001 15628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "3006a7e054f54b19a86ac0730c39d1af"
format_stamp: "Formatted at 2026-08-06 20:37:01 on dist-test-slave-2kcd"
server_key: "45e14e1d02bb6763a19141709a5569bb"
server_key_iv: "3a610f5205abdba3a5b374dfda3f5b46"
server_key_version: "encryptionkey@0"
I20260806 20:37:01.800213 15628 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:37:01.803670 15653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:01.805025 15628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:37:01.805210 15628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "3006a7e054f54b19a86ac0730c39d1af"
format_stamp: "Formatted at 2026-08-06 20:37:01 on dist-test-slave-2kcd"
server_key: "45e14e1d02bb6763a19141709a5569bb"
server_key_iv: "3a610f5205abdba3a5b374dfda3f5b46"
server_key_version: "encryptionkey@0"
I20260806 20:37:01.805401 15628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:01.823663 15628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:01.827471 15628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:01.827759 15628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:01.846771 15628 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37085
I20260806 20:37:01.846807 15738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37085 every 8 connection(s)
I20260806 20:37:01.848201 15628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:01.851917 15739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:01.854907 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15628
I20260806 20:37:01.855094 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:01.855639 13909 external_mini_cluster.cc:1428] Setting key 6fcb643728914d498bbb6b5ab07f4391
I20260806 20:37:01.864269 15739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af: Bootstrap starting.
I20260806 20:37:01.868081 15739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:01.869293 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:01.857549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:56521 (local address 127.0.0.1:37085)
0806 20:37:01.858372 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:01.858384 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:01.858426 (+ 42us) server_negotiation.cc:407] Connection header received
0806 20:37:01.860126 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:01.860148 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:01.860550 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:01.860954 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:01.861510 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:01.862814 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:01.864729 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:01.865437 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:01.865580 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:01.866934 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:01.866942 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:01.866954 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:01.867467 (+ 513us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:01.867554 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:01.867580 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:01.867693 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:01.868003 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 20:37:01.868217 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":406,"threads_started":1}
I20260806 20:37:01.869333 15739 log.cc:824] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:01.872370 15739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af: No bootstrap required, opened a new log
I20260806 20:37:01.873194 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:01.880952 15739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3006a7e054f54b19a86ac0730c39d1af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260806 20:37:01.881328 15739 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:01.881440 15739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3006a7e054f54b19a86ac0730c39d1af, State: Initialized, Role: FOLLOWER
I20260806 20:37:01.882094 15739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3006a7e054f54b19a86ac0730c39d1af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260806 20:37:01.882361 15739 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:01.882544 15739 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:01.882714 15739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:01.884305 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:01.877701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:56651 (local address 127.0.0.1:37085)
0806 20:37:01.877892 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:01.877903 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:01.878319 (+ 416us) server_negotiation.cc:407] Connection header received
0806 20:37:01.878472 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:01.878478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:01.878568 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:01.878687 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:01.879163 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:01.880323 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:01.881814 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:01.882247 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:01.882389 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:01.883553 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:01.883558 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:01.883562 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:01.883579 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:01.883625 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:01.883641 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:01.883778 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:01.883978 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 20:37:01.884036 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 20:37:01.885500 15739 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3006a7e054f54b19a86ac0730c39d1af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260806 20:37:01.886086 15739 leader_election.cc:302] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3006a7e054f54b19a86ac0730c39d1af; no voters:
I20260806 20:37:01.886735 15739 leader_election.cc:288] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:01.886878 15759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:01.887604 15759 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [term 1 LEADER]: Becoming Leader. State: Replica: 3006a7e054f54b19a86ac0730c39d1af, State: Running, Role: LEADER
I20260806 20:37:01.888127 15759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3006a7e054f54b19a86ac0730c39d1af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260806 20:37:01.888962 15739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:01.890802 15763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3006a7e054f54b19a86ac0730c39d1af. Latest consensus state: current_term: 1 leader_uuid: "3006a7e054f54b19a86ac0730c39d1af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3006a7e054f54b19a86ac0730c39d1af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } } }
I20260806 20:37:01.891250 15763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:01.891601 15761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3006a7e054f54b19a86ac0730c39d1af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3006a7e054f54b19a86ac0730c39d1af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } } }
I20260806 20:37:01.891975 15761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:01.894078 15768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:01.900388 15768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:01.914943 15768 catalog_manager.cc:1347] Generated new cluster ID: e4187fe6b4524eb18ee4fe51d8860105
I20260806 20:37:01.915140 15768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:01.936275 15768 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:01.937700 15768 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:01.946473 15768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3006a7e054f54b19a86ac0730c39d1af: Generated new TSK 0
I20260806 20:37:01.947497 15768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:01.959446 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15628
W20260806 20:37:01.960700 15732 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.94:56521
W20260806 20:37:01.961541 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15628: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:37:01.961673 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15628
W20260806 20:37:01.992528 15608 connection.cc:535] client connection to 127.0.0.1:37085 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37085): Connection reset by peer (error 104)
2026-08-06T20:37:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2214 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:02 dist-test-slave-2kcd krb5kdc[15793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:02 dist-test-slave-2kcd krb5kdc[15793](info): set up 2 sockets
Aug 06 20:37:02 dist-test-slave-2kcd krb5kdc[15793](info): commencing operation
krb5kdc: starting...
W20260806 20:37:03.313246 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.007s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:03 dist-test-slave-2kcd krb5kdc[15793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 20:37:03.644527 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42789
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:03.989355 15815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:03.989642 15815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:03.989812 15815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:03.996964 15815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:03.997073 15815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:03.997207 15815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:03.997313 15815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:03.997400 15815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:04.007226 15815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42789
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:04.008622 15815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:04.009994 15815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:04.021855 15828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:04.022117 15823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:04.022178 15826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:04.023526 15815 server_base.cc:1034] running on GCE node
I20260806 20:37:04.024400 15815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:04.025908 15815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:04.027153 15815 hybrid_clock.cc:648] HybridClock initialized: now 1786048624027124 us; error 46 us; skew 500 ppm
I20260806 20:37:04.027505 15815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:04 dist-test-slave-2kcd krb5kdc[15793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048624, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:04.030652 15815 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 20:37:04.032171 15815 webserver.cc:460] Webserver started at http://127.0.0.1:35023/ using document root <none> and password file <none>
I20260806 20:37:04.032949 15815 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:04.033107 15815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:04.033425 15815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:04.036455 15815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "e5fef21de56d413883c4bc4fd0753565"
format_stamp: "Formatted at 2026-08-06 20:37:04 on dist-test-slave-2kcd"
server_key: "c595adeedcfc684f18a50434f5c4b5a3"
server_key_iv: "d4e39f3a29eca1e438b5c7635a6a89ed"
server_key_version: "encryptionkey@0"
I20260806 20:37:04.037271 15815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "e5fef21de56d413883c4bc4fd0753565"
format_stamp: "Formatted at 2026-08-06 20:37:04 on dist-test-slave-2kcd"
server_key: "c595adeedcfc684f18a50434f5c4b5a3"
server_key_iv: "d4e39f3a29eca1e438b5c7635a6a89ed"
server_key_version: "encryptionkey@0"
I20260806 20:37:04.042482 15815 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:37:04.045964 15837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:04.047237 15815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 20:37:04.047420 15815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "e5fef21de56d413883c4bc4fd0753565"
format_stamp: "Formatted at 2026-08-06 20:37:04 on dist-test-slave-2kcd"
server_key: "c595adeedcfc684f18a50434f5c4b5a3"
server_key_iv: "d4e39f3a29eca1e438b5c7635a6a89ed"
server_key_version: "encryptionkey@0"
I20260806 20:37:04.047626 15815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:04.053710 15815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:04.057797 15815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:04.058120 15815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:04.077350 15815 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42789
I20260806 20:37:04.077435 15929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42789 every 8 connection(s)
I20260806 20:37:04.078758 15815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:04.082477 15930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:04.088258 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15815
I20260806 20:37:04.088459 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:04.089079 13909 external_mini_cluster.cc:1428] Setting key efbf87c4f6d64265328f2e1edfee9f89
I20260806 20:37:04.093637 15930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565: Bootstrap starting.
I20260806 20:37:04.097065 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:04.090976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:34181 (local address 127.0.0.1:42789)
0806 20:37:04.091881 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:04.091892 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:04.091936 (+ 44us) server_negotiation.cc:407] Connection header received
0806 20:37:04.093659 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:04.093681 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:04.094025 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:04.094333 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:04.095457 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:04.095464 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:04.095476 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:04.095494 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:04.095556 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:04.095578 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:04.095736 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:04.095899 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 20:37:04.096106 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":461,"threads_started":1}
I20260806 20:37:04.097277 15930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:04.098596 15930 log.cc:824] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:04.100919 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:04.101600 15930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565: No bootstrap required, opened a new log
I20260806 20:37:04.108292 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:04.105689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.94:54593 (local address 127.0.0.1:42789)
0806 20:37:04.105939 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:04.105957 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:04.106317 (+ 360us) server_negotiation.cc:407] Connection header received
0806 20:37:04.106475 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:04.106478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:04.106529 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:04.106616 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:04.107585 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:04.107589 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:04.107592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:04.107606 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:04.107642 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:04.107660 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:04.107771 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:04.107911 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 20:37:04.107958 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 20:37:04.110055 15930 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5fef21de56d413883c4bc4fd0753565" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42789 } }
I20260806 20:37:04.110433 15930 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:04.110544 15930 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5fef21de56d413883c4bc4fd0753565, State: Initialized, Role: FOLLOWER
I20260806 20:37:04.111158 15930 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5fef21de56d413883c4bc4fd0753565" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42789 } }
I20260806 20:37:04.111416 15930 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:04.111578 15930 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:04.111788 15930 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:04.114085 15930 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5fef21de56d413883c4bc4fd0753565" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42789 } }
I20260806 20:37:04.114544 15930 leader_election.cc:302] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5fef21de56d413883c4bc4fd0753565; no voters:
I20260806 20:37:04.115059 15930 leader_election.cc:288] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:04.115211 15948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:04.115921 15948 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [term 1 LEADER]: Becoming Leader. State: Replica: e5fef21de56d413883c4bc4fd0753565, State: Running, Role: LEADER
I20260806 20:37:04.116436 15948 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5fef21de56d413883c4bc4fd0753565" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42789 } }
I20260806 20:37:04.117317 15930 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:04.119741 15950 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5fef21de56d413883c4bc4fd0753565. Latest consensus state: current_term: 1 leader_uuid: "e5fef21de56d413883c4bc4fd0753565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5fef21de56d413883c4bc4fd0753565" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42789 } } }
I20260806 20:37:04.120229 15950 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:04.121570 15959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:04.121551 15949 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5fef21de56d413883c4bc4fd0753565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5fef21de56d413883c4bc4fd0753565" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42789 } } }
I20260806 20:37:04.121917 15949 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:04.126791 15959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:04.135803 15959 catalog_manager.cc:1347] Generated new cluster ID: d0b4f5762a734815bf3d146ba6722e22
I20260806 20:37:04.136034 15959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:04.159936 15959 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:04.160378 15959 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:04.168468 15959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5fef21de56d413883c4bc4fd0753565: Generated new TSK 0
I20260806 20:37:04.169337 15959 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:04.182251 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15815
W20260806 20:37:04.183404 15916 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.94:34181
W20260806 20:37:04.184175 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15815: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:37:04.184336 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15815
2026-08-06T20:37:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2222 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:04 dist-test-slave-2kcd krb5kdc[15981](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:04 dist-test-slave-2kcd krb5kdc[15981](info): set up 2 sockets
Aug 06 20:37:04 dist-test-slave-2kcd krb5kdc[15981](info): commencing operation
krb5kdc: starting...
W20260806 20:37:05.545953 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.005s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:05 dist-test-slave-2kcd krb5kdc[15981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:05.862367 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:43723
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:43723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:06.208750 15999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:06.209053 15999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:06.209232 15999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:06.216199 15999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:06.216306 15999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:06.216353 15999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:06.216451 15999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:06.216518 15999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:06.226366 15999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:43723
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:43723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:06.227685 15999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:06.229058 15999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:06.240932 16007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:06.241243 16006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:06.241252 16009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:06.241740 15999 server_base.cc:1034] running on GCE node
I20260806 20:37:06.242651 15999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:06.244077 15999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:06.245303 15999 hybrid_clock.cc:648] HybridClock initialized: now 1786048626245266 us; error 49 us; skew 500 ppm
I20260806 20:37:06.245656 15999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:06 dist-test-slave-2kcd krb5kdc[15981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048626, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:06.252526 15999 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:06.254554 15999 webserver.cc:460] Webserver started at http://127.13.149.126:39461/ using document root <none> and password file <none>
I20260806 20:37:06.255450 15999 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:06.255597 15999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:06.255973 15999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:06.259624 15999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "34d17a7b2f18438086873d5b294e6dd2"
format_stamp: "Formatted at 2026-08-06 20:37:06 on dist-test-slave-2kcd"
server_key: "7fff12928bf49a103a3e8842f63657b7"
server_key_iv: "007fb04baed0620270463b0842502d5c"
server_key_version: "encryptionkey@0"
I20260806 20:37:06.260407 15999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "34d17a7b2f18438086873d5b294e6dd2"
format_stamp: "Formatted at 2026-08-06 20:37:06 on dist-test-slave-2kcd"
server_key: "7fff12928bf49a103a3e8842f63657b7"
server_key_iv: "007fb04baed0620270463b0842502d5c"
server_key_version: "encryptionkey@0"
I20260806 20:37:06.265475 15999 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 20:37:06.268843 16020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:06.270061 15999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:37:06.270249 15999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "34d17a7b2f18438086873d5b294e6dd2"
format_stamp: "Formatted at 2026-08-06 20:37:06 on dist-test-slave-2kcd"
server_key: "7fff12928bf49a103a3e8842f63657b7"
server_key_iv: "007fb04baed0620270463b0842502d5c"
server_key_version: "encryptionkey@0"
I20260806 20:37:06.270442 15999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:06.296643 15999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:06.300460 15999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:06.300740 15999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:06.319535 15999 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:43723
I20260806 20:37:06.319566 16104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:43723 every 8 connection(s)
I20260806 20:37:06.320923 15999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:06.324657 16105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:06.325017 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 15999
I20260806 20:37:06.325213 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:06.325711 13909 external_mini_cluster.cc:1428] Setting key 55d538b8a1deb03a1014a268dc1c7d9d
I20260806 20:37:06.338769 16105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2: Bootstrap starting.
Aug 06 20:37:06 dist-test-slave-2kcd krb5kdc[15981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:06.342604 16105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:06.343681 16105 log.cc:824] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:06.346655 16105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2: No bootstrap required, opened a new log
I20260806 20:37:06.350232 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:06.327552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39221 (local address 127.13.149.126:43723)
0806 20:37:06.328417 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:06.328429 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:06.328473 (+ 44us) server_negotiation.cc:407] Connection header received
0806 20:37:06.330814 (+ 2341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:06.330844 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:06.331258 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:06.331589 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:06.333419 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:06.334725 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:06.336668 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:06.337406 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:06.337533 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:06.342549 (+ 5016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:06.342557 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:06.342572 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:06.342613 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:06.345963 (+ 3350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:06.346777 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:06.346787 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:06.346795 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:06.346975 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:06.347471 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:06.347475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:06.347477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:06.347976 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:06.348331 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:06.348885 (+ 554us) server_negotiation.cc:299] Negotiation successful
0806 20:37:06.349233 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":439,"threads_started":1}
I20260806 20:37:06.354068 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:06.355099 16105 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d17a7b2f18438086873d5b294e6dd2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43723 } }
I20260806 20:37:06.355468 16105 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:06.355580 16105 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34d17a7b2f18438086873d5b294e6dd2, State: Initialized, Role: FOLLOWER
I20260806 20:37:06.356109 16105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d17a7b2f18438086873d5b294e6dd2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43723 } }
I20260806 20:37:06.356359 16105 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:06.356506 16105 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:06.356714 16105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:06.359167 16105 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d17a7b2f18438086873d5b294e6dd2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43723 } }
I20260806 20:37:06.359675 16105 leader_election.cc:302] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34d17a7b2f18438086873d5b294e6dd2; no voters:
I20260806 20:37:06.360350 16105 leader_election.cc:288] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:06.360456 16121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:06.362987 16105 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:06.364468 16121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [term 1 LEADER]: Becoming Leader. State: Replica: 34d17a7b2f18438086873d5b294e6dd2, State: Running, Role: LEADER
I20260806 20:37:06.365160 16121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d17a7b2f18438086873d5b294e6dd2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43723 } }
I20260806 20:37:06.368441 16124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34d17a7b2f18438086873d5b294e6dd2. Latest consensus state: current_term: 1 leader_uuid: "34d17a7b2f18438086873d5b294e6dd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d17a7b2f18438086873d5b294e6dd2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43723 } } }
I20260806 20:37:06.368956 16124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:06.368400 16123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34d17a7b2f18438086873d5b294e6dd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d17a7b2f18438086873d5b294e6dd2" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 43723 } } }
I20260806 20:37:06.369630 16123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:06.371687 16136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:06.377501 16136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:06.378569 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:06.358753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37411 (local address 127.13.149.126:43723)
0806 20:37:06.358947 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:06.358955 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:06.359395 (+ 440us) server_negotiation.cc:407] Connection header received
0806 20:37:06.359607 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:06.359619 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:06.359685 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:06.359792 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:06.361605 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:06.362478 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:06.363809 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:06.364415 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:06.364572 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:06.368525 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:06.368533 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:06.368538 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:06.368595 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:06.373714 (+ 5119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:06.374792 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:06.374798 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:06.374801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:06.374956 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:06.375572 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:06.375577 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:06.375580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:06.376222 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:06.376616 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:06.377935 (+ 1319us) server_negotiation.cc:299] Negotiation successful
0806 20:37:06.378131 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":63}
I20260806 20:37:06.386999 16136 catalog_manager.cc:1347] Generated new cluster ID: ddc934f160b24bd7ab4488ff4b9c2ee6
I20260806 20:37:06.387107 16136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:06.403707 16136 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:06.404989 16136 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:06.416530 16136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34d17a7b2f18438086873d5b294e6dd2: Generated new TSK 0
I20260806 20:37:06.417541 16136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:06.429211 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 15999
I20260806 20:37:06.430465 16100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:06.523273 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 15999
W20260806 20:37:06.548120 15979 connection.cc:535] client connection to 127.13.149.126:43723 recv error: Network error: failed to read from TLS socket (remote: 127.13.149.126:43723): Connection reset by peer (error 104)
2026-08-06T20:37:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2332 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:06 dist-test-slave-2kcd krb5kdc[16153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:06 dist-test-slave-2kcd krb5kdc[16153](info): set up 2 sockets
Aug 06 20:37:06 dist-test-slave-2kcd krb5kdc[16153](info): commencing operation
krb5kdc: starting...
W20260806 20:37:07.902602 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.335s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:08 dist-test-slave-2kcd krb5kdc[16153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:08.211822 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35899
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:45935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:35899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:08.555446 16176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:08.555713 16176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:08.555804 16176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:08.562852 16176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:08.562954 16176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:08.563055 16176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:08.563159 16176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:08.563241 16176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:08.572713 16176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:45935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:35899
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:35899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:08.573969 16176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:08.575278 16176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:08.587440 16186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:08.587550 16183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:08.587680 16182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:08.593430 16176 server_base.cc:1034] running on GCE node
I20260806 20:37:08.594177 16176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:08.595449 16176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:08.596675 16176 hybrid_clock.cc:648] HybridClock initialized: now 1786048628596646 us; error 45 us; skew 500 ppm
I20260806 20:37:08.597110 16176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:08 dist-test-slave-2kcd krb5kdc[16153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048628, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:08.600153 16176 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:08.601661 16176 webserver.cc:460] Webserver started at http://127.13.149.126:33539/ using document root <none> and password file <none>
I20260806 20:37:08.602344 16176 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:08.602499 16176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:08.602800 16176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:08.605746 16176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "7f074a6d2ce7418db93896879be79cd4"
format_stamp: "Formatted at 2026-08-06 20:37:08 on dist-test-slave-2kcd"
server_key: "6242ccafc1b8faa73509cebfff7ae02f"
server_key_iv: "9402333d19bb53d1e159167f72de45fa"
server_key_version: "encryptionkey@0"
I20260806 20:37:08.606498 16176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "7f074a6d2ce7418db93896879be79cd4"
format_stamp: "Formatted at 2026-08-06 20:37:08 on dist-test-slave-2kcd"
server_key: "6242ccafc1b8faa73509cebfff7ae02f"
server_key_iv: "9402333d19bb53d1e159167f72de45fa"
server_key_version: "encryptionkey@0"
I20260806 20:37:08.611481 16176 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 20:37:08.614802 16197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:08.616329 16176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:37:08.616513 16176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "7f074a6d2ce7418db93896879be79cd4"
format_stamp: "Formatted at 2026-08-06 20:37:08 on dist-test-slave-2kcd"
server_key: "6242ccafc1b8faa73509cebfff7ae02f"
server_key_iv: "9402333d19bb53d1e159167f72de45fa"
server_key_version: "encryptionkey@0"
I20260806 20:37:08.616703 16176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:08.628134 16176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:08.631839 16176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:08.632121 16176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:08.651870 16176 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:35899
I20260806 20:37:08.651878 16271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:35899 every 8 connection(s)
I20260806 20:37:08.653393 16176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:08.657145 16273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:08.663177 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16176
I20260806 20:37:08.663388 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:08.663964 13909 external_mini_cluster.cc:1428] Setting key 4868e685eb92d08d1f23e495d550ca05
I20260806 20:37:08.668460 16273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4: Bootstrap starting.
I20260806 20:37:08.672152 16273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:08.673455 16273 log.cc:824] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:08.676928 16273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4: No bootstrap required, opened a new log
I20260806 20:37:08.678128 16280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:08.665883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47929 (local address 127.13.149.126:35899)
0806 20:37:08.666775 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:08.666786 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:08.666827 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:37:08.668473 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:08.668496 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:08.668996 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:08.669310 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:08.669940 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:08.671218 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:08.673204 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:08.674044 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:08.674267 (+ 223us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:08.675398 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:08.675409 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:08.675435 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:08.676138 (+ 703us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:08.676238 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:08.676271 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:08.676464 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:08.676618 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 20:37:08.676810 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":465,"threads_started":1}
I20260806 20:37:08.681936 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:08.686906 16273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f074a6d2ce7418db93896879be79cd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35899 } }
I20260806 20:37:08.687361 16273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:08.687498 16273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f074a6d2ce7418db93896879be79cd4, State: Initialized, Role: FOLLOWER
I20260806 20:37:08.688122 16273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f074a6d2ce7418db93896879be79cd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35899 } }
I20260806 20:37:08.688365 16273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:08.688527 16273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:08.688745 16273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:08.691028 16273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f074a6d2ce7418db93896879be79cd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35899 } }
I20260806 20:37:08.691531 16273 leader_election.cc:302] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f074a6d2ce7418db93896879be79cd4; no voters:
I20260806 20:37:08.692235 16273 leader_election.cc:288] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:08.692360 16287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:08.694082 16280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:08.687324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35869 (local address 127.13.149.126:35899)
0806 20:37:08.688078 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:08.688082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:08.688095 (+ 13us) server_negotiation.cc:407] Connection header received
0806 20:37:08.688151 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:08.688154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:08.688202 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:08.688308 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:08.688979 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:08.689761 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:08.691085 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:08.691600 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:08.691736 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:08.693095 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:08.693101 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:08.693105 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:08.693126 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:08.693185 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:08.693202 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:08.693300 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:08.693625 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 20:37:08.693687 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656}
I20260806 20:37:08.693732 16287 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [term 1 LEADER]: Becoming Leader. State: Replica: 7f074a6d2ce7418db93896879be79cd4, State: Running, Role: LEADER
I20260806 20:37:08.694684 16273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:08.695194 16287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f074a6d2ce7418db93896879be79cd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35899 } }
I20260806 20:37:08.698411 16289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f074a6d2ce7418db93896879be79cd4. Latest consensus state: current_term: 1 leader_uuid: "7f074a6d2ce7418db93896879be79cd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f074a6d2ce7418db93896879be79cd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35899 } } }
I20260806 20:37:08.698840 16289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:08.699349 16288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f074a6d2ce7418db93896879be79cd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f074a6d2ce7418db93896879be79cd4" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 35899 } } }
I20260806 20:37:08.699605 16288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:08.702176 16312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:08.707459 16312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:08.716748 16312 catalog_manager.cc:1347] Generated new cluster ID: e0a13f1668d44e5bb74295ea5ce42109
I20260806 20:37:08.716905 16312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:08.743371 16312 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:08.744709 16312 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:08.758769 16312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f074a6d2ce7418db93896879be79cd4: Generated new TSK 0
I20260806 20:37:08.759641 16312 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:08.766453 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16176
W20260806 20:37:08.767767 16265 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47929
W20260806 20:37:08.768640 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16176: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:37:08.768827 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16176
W20260806 20:37:08.794773 16151 connection.cc:535] client connection to 127.13.149.126:35899 recv error: Network error: failed to read from TLS socket (remote: 127.13.149.126:35899): Connection reset by peer (error 104)
2026-08-06T20:37:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2246 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:08 dist-test-slave-2kcd krb5kdc[16325](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:08 dist-test-slave-2kcd krb5kdc[16325](info): set up 2 sockets
Aug 06 20:37:08 dist-test-slave-2kcd krb5kdc[16325](info): commencing operation
krb5kdc: starting...
W20260806 20:37:10.138778 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.002s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:10 dist-test-slave-2kcd krb5kdc[16325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:10.462299 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40767
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:44471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:40767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:10.809036 16346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:10.809336 16346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:10.809509 16346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:10.816810 16346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:10.816918 16346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:10.817040 16346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:10.817154 16346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:10.817232 16346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:10.827142 16346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:44471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:40767
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:40767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:10.828510 16346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:10.829916 16346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:10.842423 16358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:10.842514 16362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:10.842531 16355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:10.843372 16346 server_base.cc:1034] running on GCE node
I20260806 20:37:10.844235 16346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:10.845659 16346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:10.846868 16346 hybrid_clock.cc:648] HybridClock initialized: now 1786048630846825 us; error 40 us; skew 500 ppm
I20260806 20:37:10.847219 16346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:10 dist-test-slave-2kcd krb5kdc[16325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048630, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:10.850485 16346 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:10.851949 16346 webserver.cc:460] Webserver started at http://127.13.149.126:37385/ using document root <none> and password file <none>
I20260806 20:37:10.852622 16346 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:10.852759 16346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:10.853140 16346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:10.856128 16346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "9540ec9cf4c4415db3131eec0a0da0bb"
format_stamp: "Formatted at 2026-08-06 20:37:10 on dist-test-slave-2kcd"
server_key: "0199cb99c4d78f48acd04152e0ef5477"
server_key_iv: "0260cef3bb8aa16fff313d995f8d7ced"
server_key_version: "encryptionkey@0"
I20260806 20:37:10.856961 16346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "9540ec9cf4c4415db3131eec0a0da0bb"
format_stamp: "Formatted at 2026-08-06 20:37:10 on dist-test-slave-2kcd"
server_key: "0199cb99c4d78f48acd04152e0ef5477"
server_key_iv: "0260cef3bb8aa16fff313d995f8d7ced"
server_key_version: "encryptionkey@0"
I20260806 20:37:10.862005 16346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:37:10.865371 16371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:10.866640 16346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:37:10.866837 16346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "9540ec9cf4c4415db3131eec0a0da0bb"
format_stamp: "Formatted at 2026-08-06 20:37:10 on dist-test-slave-2kcd"
server_key: "0199cb99c4d78f48acd04152e0ef5477"
server_key_iv: "0260cef3bb8aa16fff313d995f8d7ced"
server_key_version: "encryptionkey@0"
I20260806 20:37:10.867038 16346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:10.872921 16346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:10.877424 16346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:10.877734 16346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:10.896895 16346 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:40767
I20260806 20:37:10.896914 16451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:40767 every 8 connection(s)
I20260806 20:37:10.898269 16346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:10.901952 16454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:10.905324 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16346
I20260806 20:37:10.905519 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:10.905967 13909 external_mini_cluster.cc:1428] Setting key 2bb3e1b3eefda56286fa6b78cac57e5d
I20260806 20:37:10.913594 16460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:10.907699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53823 (local address 127.13.149.126:40767)
0806 20:37:10.908481 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:10.908492 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:10.908532 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:37:10.910202 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:10.910223 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:10.910565 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:10.910873 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:10.911955 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:10.911961 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:10.911973 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:10.911987 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:10.912049 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:10.912071 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:10.912240 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:10.912412 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 20:37:10.912648 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":359,"threads_started":1}
I20260806 20:37:10.914407 16454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb: Bootstrap starting.
I20260806 20:37:10.917294 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:10.917850 16454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:10.918843 16454 log.cc:824] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:10.922168 16454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb: No bootstrap required, opened a new log
I20260806 20:37:10.924450 16460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:10.921913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54445 (local address 127.13.149.126:40767)
0806 20:37:10.922119 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:10.922127 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:10.922516 (+ 389us) server_negotiation.cc:407] Connection header received
0806 20:37:10.922719 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:10.922731 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:10.922774 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:10.922877 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:10.923789 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:10.923795 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:10.923799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:10.923817 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:10.923862 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:10.923880 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:10.924007 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:10.924110 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 20:37:10.924177 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 20:37:10.930191 16454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40767 } }
I20260806 20:37:10.930588 16454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:10.930719 16454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9540ec9cf4c4415db3131eec0a0da0bb, State: Initialized, Role: FOLLOWER
I20260806 20:37:10.931341 16454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40767 } }
I20260806 20:37:10.931584 16454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:10.931736 16454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:10.931915 16454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:10.934566 16454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40767 } }
I20260806 20:37:10.935084 16454 leader_election.cc:302] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9540ec9cf4c4415db3131eec0a0da0bb; no voters:
I20260806 20:37:10.935700 16454 leader_election.cc:288] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:10.935837 16472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:10.936545 16472 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [term 1 LEADER]: Becoming Leader. State: Replica: 9540ec9cf4c4415db3131eec0a0da0bb, State: Running, Role: LEADER
I20260806 20:37:10.937178 16472 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40767 } }
I20260806 20:37:10.937928 16454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:10.940158 16474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40767 } } }
I20260806 20:37:10.940656 16474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:10.940987 16477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9540ec9cf4c4415db3131eec0a0da0bb. Latest consensus state: current_term: 1 leader_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9540ec9cf4c4415db3131eec0a0da0bb" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 40767 } } }
I20260806 20:37:10.941352 16477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:10.944459 16484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:10.950114 16484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:10.959285 16484 catalog_manager.cc:1347] Generated new cluster ID: da6e24abea7040069dd39bfb13ff0fc5
I20260806 20:37:10.959414 16484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:10.972025 16484 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:10.972430 16484 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:10.980173 16484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9540ec9cf4c4415db3131eec0a0da0bb: Generated new TSK 0
I20260806 20:37:10.980933 16484 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:10.991789 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16346
W20260806 20:37:10.992868 16441 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53823
W20260806 20:37:10.993598 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16346: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:37:10.993765 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16346
2026-08-06T20:37:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2224 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:11 dist-test-slave-2kcd krb5kdc[16507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:11 dist-test-slave-2kcd krb5kdc[16507](info): set up 2 sockets
Aug 06 20:37:11 dist-test-slave-2kcd krb5kdc[16507](info): commencing operation
krb5kdc: starting...
W20260806 20:37:12.334780 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.003s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:12 dist-test-slave-2kcd krb5kdc[16507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:12.671906 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42503
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:32861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:42503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:13.014324 16522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:13.014604 16522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:13.014777 16522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:13.021937 16522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:13.022068 16522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:13.022158 16522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:13.022269 16522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:13.022349 16522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:13.031986 16522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:32861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:42503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:42503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:13.033269 16522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:13.034595 16522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:13.046442 16538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:13.046636 16535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:13.047013 16536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:13.047344 16522 server_base.cc:1034] running on GCE node
I20260806 20:37:13.048053 16522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:13.049451 16522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:13.050690 16522 hybrid_clock.cc:648] HybridClock initialized: now 1786048633050656 us; error 47 us; skew 500 ppm
I20260806 20:37:13.051064 16522 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:13 dist-test-slave-2kcd krb5kdc[16507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048633, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:13.058377 16522 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:13.059693 16522 webserver.cc:460] Webserver started at http://127.13.149.126:37471/ using document root <none> and password file <none>
I20260806 20:37:13.060361 16522 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:13.060462 16522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:13.060707 16522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:13.063591 16522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "9ff9405c915640efa4af298612dbdffd"
format_stamp: "Formatted at 2026-08-06 20:37:13 on dist-test-slave-2kcd"
server_key: "28be05bb1cb58ef41ff694e69af3e716"
server_key_iv: "055e17e79e4744b798fcdb4f1321e022"
server_key_version: "encryptionkey@0"
I20260806 20:37:13.064275 16522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "9ff9405c915640efa4af298612dbdffd"
format_stamp: "Formatted at 2026-08-06 20:37:13 on dist-test-slave-2kcd"
server_key: "28be05bb1cb58ef41ff694e69af3e716"
server_key_iv: "055e17e79e4744b798fcdb4f1321e022"
server_key_version: "encryptionkey@0"
I20260806 20:37:13.069243 16522 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 20:37:13.072513 16550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:13.073767 16522 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:37:13.073952 16522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "9ff9405c915640efa4af298612dbdffd"
format_stamp: "Formatted at 2026-08-06 20:37:13 on dist-test-slave-2kcd"
server_key: "28be05bb1cb58ef41ff694e69af3e716"
server_key_iv: "055e17e79e4744b798fcdb4f1321e022"
server_key_version: "encryptionkey@0"
I20260806 20:37:13.074141 16522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:13.094215 16522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:13.098507 16522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:13.098786 16522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:13.117501 16522 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:42503
I20260806 20:37:13.117506 16637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:42503 every 8 connection(s)
I20260806 20:37:13.118927 16522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:13.121110 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16522
I20260806 20:37:13.121313 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:13.121768 13909 external_mini_cluster.cc:1428] Setting key 02942f91369fa4de35dcbeccb0d9cd3c
I20260806 20:37:13.122913 16639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 20:37:13 dist-test-slave-2kcd krb5kdc[16507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:13.136428 16639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd: Bootstrap starting.
I20260806 20:37:13.140524 16639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:13.141907 16639 log.cc:824] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:13.145445 16639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd: No bootstrap required, opened a new log
I20260806 20:37:13.146481 16647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:13.123510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54999 (local address 127.13.149.126:42503)
0806 20:37:13.124285 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:13.124302 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:13.124354 (+ 52us) server_negotiation.cc:407] Connection header received
0806 20:37:13.126405 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:13.126432 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:13.126947 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:13.127371 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:13.128730 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:13.130811 (+ 2081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:13.132082 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:13.133199 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:13.133399 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:13.137629 (+ 4230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:13.137640 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:13.137658 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:13.137702 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:13.141765 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:13.142546 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:13.142559 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:13.142571 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:13.142791 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:13.143249 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:13.143252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:13.143254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:13.143978 (+ 724us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:13.144275 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:13.144678 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 20:37:13.145115 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":337,"threads_started":1}
I20260806 20:37:13.150358 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:13.154109 16639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff9405c915640efa4af298612dbdffd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42503 } }
I20260806 20:37:13.154472 16639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:13.154608 16639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff9405c915640efa4af298612dbdffd, State: Initialized, Role: FOLLOWER
I20260806 20:37:13.155310 16639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff9405c915640efa4af298612dbdffd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42503 } }
I20260806 20:37:13.155601 16639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:13.155776 16639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:13.155992 16639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:13.159041 16639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff9405c915640efa4af298612dbdffd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42503 } }
I20260806 20:37:13.159643 16639 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ff9405c915640efa4af298612dbdffd; no voters:
I20260806 20:37:13.160281 16639 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:13.160400 16658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:13.162343 16639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:13.167244 16658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [term 1 LEADER]: Becoming Leader. State: Replica: 9ff9405c915640efa4af298612dbdffd, State: Running, Role: LEADER
I20260806 20:37:13.167794 16658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff9405c915640efa4af298612dbdffd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42503 } }
I20260806 20:37:13.170519 16659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ff9405c915640efa4af298612dbdffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff9405c915640efa4af298612dbdffd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42503 } } }
I20260806 20:37:13.170890 16659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:13.171458 16660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ff9405c915640efa4af298612dbdffd. Latest consensus state: current_term: 1 leader_uuid: "9ff9405c915640efa4af298612dbdffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff9405c915640efa4af298612dbdffd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 42503 } } }
I20260806 20:37:13.171893 16660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:13.175778 16647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:13.154629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47525 (local address 127.13.149.126:42503)
0806 20:37:13.154802 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:13.154809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:13.155469 (+ 660us) server_negotiation.cc:407] Connection header received
0806 20:37:13.155723 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:13.155730 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:13.155803 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:13.155914 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:13.157782 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:13.158543 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:13.160366 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:13.161316 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:13.161475 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:13.165555 (+ 4080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:13.165561 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:13.165566 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:13.165601 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:13.170461 (+ 4860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:13.171622 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:13.171631 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:13.171641 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:13.171916 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:13.172533 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:13.172541 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:13.172547 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:13.173100 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:13.174756 (+ 1656us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:13.174939 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 20:37:13.175236 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 20:37:13.188304 16672 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:13.193881 16672 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:13.202816 16672 catalog_manager.cc:1347] Generated new cluster ID: b5770c85fe174e80b700c4495e43f7a3
I20260806 20:37:13.202924 16672 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:13.224465 16672 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:13.226410 16672 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:13.246758 16672 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ff9405c915640efa4af298612dbdffd: Generated new TSK 0
I20260806 20:37:13.247565 16672 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:13.254706 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16522
I20260806 20:37:13.255745 16630 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:13.348039 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16522
2026-08-06T20:37:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2355 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:13 dist-test-slave-2kcd krb5kdc[16690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:13 dist-test-slave-2kcd krb5kdc[16690](info): set up 2 sockets
Aug 06 20:37:13 dist-test-slave-2kcd krb5kdc[16690](info): commencing operation
krb5kdc: starting...
W20260806 20:37:14.705961 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:14 dist-test-slave-2kcd krb5kdc[16690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:15.051921 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:36659
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:36659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:15.396823 16707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:15.397179 16707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:15.397341 16707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:15.405133 16707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:15.405279 16707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:15.405387 16707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:15.405496 16707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:15.405575 16707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:15.415489 16707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:36659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:36659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:15.416886 16707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:15.418223 16707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:15.430981 16714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:15.431068 16715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:15.431027 16717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:15.432016 16707 server_base.cc:1034] running on GCE node
I20260806 20:37:15.432881 16707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:15.434310 16707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:15.435562 16707 hybrid_clock.cc:648] HybridClock initialized: now 1786048635435524 us; error 51 us; skew 500 ppm
I20260806 20:37:15.435958 16707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:15 dist-test-slave-2kcd krb5kdc[16690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048635, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:15.439148 16707 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:15.440698 16707 webserver.cc:460] Webserver started at http://127.13.149.126:35297/ using document root <none> and password file <none>
I20260806 20:37:15.441409 16707 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:15.441566 16707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:15.441887 16707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:15.444962 16707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "66a64207930649dc95ed2e547aea3368"
format_stamp: "Formatted at 2026-08-06 20:37:15 on dist-test-slave-2kcd"
server_key: "8cbde8903d1e956e196f7ab706b7cf5b"
server_key_iv: "647c8e030698a27ee1fb4b26ef986746"
server_key_version: "encryptionkey@0"
I20260806 20:37:15.445762 16707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "66a64207930649dc95ed2e547aea3368"
format_stamp: "Formatted at 2026-08-06 20:37:15 on dist-test-slave-2kcd"
server_key: "8cbde8903d1e956e196f7ab706b7cf5b"
server_key_iv: "647c8e030698a27ee1fb4b26ef986746"
server_key_version: "encryptionkey@0"
I20260806 20:37:15.451174 16707 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 20:37:15.454763 16728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:15.456175 16707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:37:15.456377 16707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "66a64207930649dc95ed2e547aea3368"
format_stamp: "Formatted at 2026-08-06 20:37:15 on dist-test-slave-2kcd"
server_key: "8cbde8903d1e956e196f7ab706b7cf5b"
server_key_iv: "647c8e030698a27ee1fb4b26ef986746"
server_key_version: "encryptionkey@0"
I20260806 20:37:15.456588 16707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:15.481235 16707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:15.485649 16707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:15.486003 16707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:15.505865 16707 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:36659
I20260806 20:37:15.505890 16808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:36659 every 8 connection(s)
I20260806 20:37:15.507311 16707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:15.511189 16813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:15.516844 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16707
I20260806 20:37:15.517066 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:15.517628 13909 external_mini_cluster.cc:1428] Setting key a697c2ba1734bf443345509d2c9de571
I20260806 20:37:15.522428 16813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368: Bootstrap starting.
I20260806 20:37:15.526073 16813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:15.527244 16813 log.cc:824] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:15.530037 16813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368: No bootstrap required, opened a new log
I20260806 20:37:15.531137 16820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:15.519507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42293 (local address 127.13.149.126:36659)
0806 20:37:15.520352 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:15.520364 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:15.520417 (+ 53us) server_negotiation.cc:407] Connection header received
0806 20:37:15.522166 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:15.522189 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:15.522621 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:15.522930 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:15.523561 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:15.524924 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:15.526762 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:15.527498 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:15.527622 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:15.528965 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:15.528973 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:15.528987 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:15.529503 (+ 516us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:15.529572 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:15.529601 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:15.529741 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:15.529961 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 20:37:15.530227 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":405,"threads_started":1}
I20260806 20:37:15.534837 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:15.538594 16813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a64207930649dc95ed2e547aea3368" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36659 } }
I20260806 20:37:15.538980 16813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:15.539122 16813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a64207930649dc95ed2e547aea3368, State: Initialized, Role: FOLLOWER
I20260806 20:37:15.539901 16813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a64207930649dc95ed2e547aea3368" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36659 } }
I20260806 20:37:15.540230 16813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:15.540426 16813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:15.540611 16813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:15.543509 16813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a64207930649dc95ed2e547aea3368" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36659 } }
I20260806 20:37:15.544034 16813 leader_election.cc:302] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66a64207930649dc95ed2e547aea3368; no voters:
I20260806 20:37:15.544713 16813 leader_election.cc:288] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:15.544833 16833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:15.546530 16820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:15.539245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41677 (local address 127.13.149.126:36659)
0806 20:37:15.539462 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:15.539470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:15.539868 (+ 398us) server_negotiation.cc:407] Connection header received
0806 20:37:15.540078 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:15.540082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:15.540168 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:15.540296 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:15.540908 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:15.541858 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:15.543343 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:15.543901 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:15.544090 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:15.545397 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:15.545406 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:15.545414 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:15.545445 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:15.545511 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:15.545541 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:15.545621 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:15.545889 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 20:37:15.546050 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 20:37:15.546933 16813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:15.547753 16833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [term 1 LEADER]: Becoming Leader. State: Replica: 66a64207930649dc95ed2e547aea3368, State: Running, Role: LEADER
I20260806 20:37:15.548384 16833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a64207930649dc95ed2e547aea3368" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36659 } }
I20260806 20:37:15.551829 16837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66a64207930649dc95ed2e547aea3368. Latest consensus state: current_term: 1 leader_uuid: "66a64207930649dc95ed2e547aea3368" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a64207930649dc95ed2e547aea3368" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36659 } } }
I20260806 20:37:15.552270 16837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:15.553049 16836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66a64207930649dc95ed2e547aea3368" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a64207930649dc95ed2e547aea3368" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 36659 } } }
I20260806 20:37:15.553418 16836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:15.558346 16850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:15.562695 16850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:15.570752 16850 catalog_manager.cc:1347] Generated new cluster ID: 08089ffea1a9417dba4ae1f1ce06b9e5
I20260806 20:37:15.570864 16850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:15.595489 16850 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:15.597481 16850 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:15.615528 16850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66a64207930649dc95ed2e547aea3368: Generated new TSK 0
I20260806 20:37:15.616629 16850 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:15.626351 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16707
W20260806 20:37:15.627550 16802 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42293
W20260806 20:37:15.628391 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16707: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:37:15.628545 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16707
2026-08-06T20:37:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2282 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:15 dist-test-slave-2kcd krb5kdc[16870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:15 dist-test-slave-2kcd krb5kdc[16870](info): set up 2 sockets
Aug 06 20:37:15 dist-test-slave-2kcd krb5kdc[16870](info): commencing operation
krb5kdc: starting...
W20260806 20:37:16.978657 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:17 dist-test-slave-2kcd krb5kdc[16870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:17.304471 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:33489
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:33489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:17.649638 16890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:17.649932 16890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:17.650148 16890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:17.657358 16890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:17.657471 16890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:17.657595 16890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:17.657702 16890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:17.657784 16890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:17.668416 16890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:33489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:33489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:17.669842 16890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:17.671412 16890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:17.685222 16896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:17.685309 16897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:17.685276 16900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:17.686812 16890 server_base.cc:1034] running on GCE node
I20260806 20:37:17.687706 16890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:17.689265 16890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:17.690507 16890 hybrid_clock.cc:648] HybridClock initialized: now 1786048637690469 us; error 51 us; skew 500 ppm
I20260806 20:37:17.690873 16890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:17 dist-test-slave-2kcd krb5kdc[16870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048637, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:17.694135 16890 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:17.695724 16890 webserver.cc:460] Webserver started at http://127.13.149.126:37099/ using document root <none> and password file <none>
I20260806 20:37:17.696432 16890 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:17.696589 16890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:17.696990 16890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:17.699980 16890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "e3ba621965cb4864b61a12cb37d087cd"
format_stamp: "Formatted at 2026-08-06 20:37:17 on dist-test-slave-2kcd"
server_key: "d0bd3c75f4cf03e482baeb57bd4a4d73"
server_key_iv: "72f28766c1f399b90c2e2da2b3022c77"
server_key_version: "encryptionkey@0"
I20260806 20:37:17.700826 16890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "e3ba621965cb4864b61a12cb37d087cd"
format_stamp: "Formatted at 2026-08-06 20:37:17 on dist-test-slave-2kcd"
server_key: "d0bd3c75f4cf03e482baeb57bd4a4d73"
server_key_iv: "72f28766c1f399b90c2e2da2b3022c77"
server_key_version: "encryptionkey@0"
I20260806 20:37:17.706168 16890 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 20:37:17.709717 16915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:17.711086 16890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:37:17.711272 16890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "e3ba621965cb4864b61a12cb37d087cd"
format_stamp: "Formatted at 2026-08-06 20:37:17 on dist-test-slave-2kcd"
server_key: "d0bd3c75f4cf03e482baeb57bd4a4d73"
server_key_iv: "72f28766c1f399b90c2e2da2b3022c77"
server_key_version: "encryptionkey@0"
I20260806 20:37:17.711479 16890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:17.717535 16890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:17.721726 16890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:17.722040 16890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:17.742079 16890 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:33489
I20260806 20:37:17.742111 16993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:33489 every 8 connection(s)
I20260806 20:37:17.743530 16890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:17.746856 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 16890
I20260806 20:37:17.747056 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:17.747490 13909 external_mini_cluster.cc:1428] Setting key fa97165fdee529cea890c17d97606759
I20260806 20:37:17.747594 16995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:17.755841 17003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:17.749293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32797 (local address 127.13.149.126:33489)
0806 20:37:17.750103 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:17.750115 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:17.750159 (+ 44us) server_negotiation.cc:407] Connection header received
0806 20:37:17.752317 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:17.752338 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:17.752674 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:17.753137 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:17.754264 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:17.754270 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:17.754282 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:17.754302 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:17.754355 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:17.754376 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:17.754634 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:17.754787 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 20:37:17.754957 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":348,"threads_started":1}
I20260806 20:37:17.759577 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:17.761184 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd: Bootstrap starting.
I20260806 20:37:17.764897 16995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:17.766115 16995 log.cc:824] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:17.766758 17003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:17.764009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39335 (local address 127.13.149.126:33489)
0806 20:37:17.764227 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:17.764234 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:17.764636 (+ 402us) server_negotiation.cc:407] Connection header received
0806 20:37:17.764840 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:17.764845 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:17.764905 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:17.765015 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:17.765990 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:17.765996 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:17.766007 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 20:37:17.766022 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:17.766059 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 20:37:17.766074 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:17.766196 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:17.766367 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 20:37:17.766428 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 20:37:17.769263 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd: No bootstrap required, opened a new log
I20260806 20:37:17.776697 16995 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ba621965cb4864b61a12cb37d087cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 33489 } }
I20260806 20:37:17.777150 16995 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 20:37:17.777271 16995 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ba621965cb4864b61a12cb37d087cd, State: Initialized, Role: FOLLOWER
I20260806 20:37:17.777851 16995 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ba621965cb4864b61a12cb37d087cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 33489 } }
I20260806 20:37:17.778091 16995 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 20:37:17.778270 16995 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 20:37:17.778457 16995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:17.780714 16995 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ba621965cb4864b61a12cb37d087cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 33489 } }
I20260806 20:37:17.781282 16995 leader_election.cc:302] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3ba621965cb4864b61a12cb37d087cd; no voters:
I20260806 20:37:17.781966 16995 leader_election.cc:288] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 20:37:17.782105 17013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:17.782931 17013 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [term 1 LEADER]: Becoming Leader. State: Replica: e3ba621965cb4864b61a12cb37d087cd, State: Running, Role: LEADER
I20260806 20:37:17.783512 17013 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ba621965cb4864b61a12cb37d087cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 33489 } }
I20260806 20:37:17.784157 16995 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:17.786677 17015 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3ba621965cb4864b61a12cb37d087cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ba621965cb4864b61a12cb37d087cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 33489 } } }
I20260806 20:37:17.787129 17017 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3ba621965cb4864b61a12cb37d087cd. Latest consensus state: current_term: 1 leader_uuid: "e3ba621965cb4864b61a12cb37d087cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3ba621965cb4864b61a12cb37d087cd" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 33489 } } }
I20260806 20:37:17.787647 17015 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:17.787652 17017 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:17.789397 17025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:17.794783 17025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:17.803653 17025 catalog_manager.cc:1347] Generated new cluster ID: 89c56a1615a24fb49e0f54513c390e8c
I20260806 20:37:17.803776 17025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:17.839170 17025 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:17.839639 17025 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:17.847255 17025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3ba621965cb4864b61a12cb37d087cd: Generated new TSK 0
I20260806 20:37:17.848330 17025 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:17.861836 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16890
W20260806 20:37:17.863030 16986 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:32797
W20260806 20:37:17.863742 13909 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 16890: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 20:37:17.863901 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 16890
2026-08-06T20:37:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2230 ms)
[----------] 18 tests from AuthTokenIssuingTest (40689 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:17 dist-test-slave-2kcd krb5kdc[17045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:17 dist-test-slave-2kcd krb5kdc[17045](info): set up 2 sockets
Aug 06 20:37:17 dist-test-slave-2kcd krb5kdc[17045](info): commencing operation
krb5kdc: starting...
W20260806 20:37:19.209451 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.003s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:19 dist-test-slave-2kcd krb5kdc[17045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:19.572533 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38535
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:38535,127.13.149.125:46441,127.13.149.124:40689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:19.920040 17064 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 20:37:19.920456 17064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:19.920599 17064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:19.920749 17064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:19.928102 17064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:19.928227 17064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:19.928334 17064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:19.928426 17064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:19.928527 17064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:19.938753 17064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:38535,127.13.149.125:46441,127.13.149.124:40689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:38535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:19.940168 17064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:19.941618 17064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:19.953758 17074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:19.953786 17076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:19.953842 17073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:19.954604 17064 server_base.cc:1034] running on GCE node
I20260806 20:37:19.955494 17064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:19.956974 17064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:19.958228 17064 hybrid_clock.cc:648] HybridClock initialized: now 1786048639958170 us; error 53 us; skew 500 ppm
I20260806 20:37:19.958593 17064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:19 dist-test-slave-2kcd krb5kdc[17045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:19.961849 17064 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:19.963318 17064 webserver.cc:460] Webserver started at http://127.13.149.126:39135/ using document root <none> and password file <none>
I20260806 20:37:19.963984 17064 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:19.964074 17064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:19.964335 17064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:19.967384 17064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "d126604a21704f60ad96e2faa5af73f7"
format_stamp: "Formatted at 2026-08-06 20:37:19 on dist-test-slave-2kcd"
server_key: "1ae686201ff7a561decd99c1945b945f"
server_key_iv: "296f7a2fa24de1189e5ce5c766e18366"
server_key_version: "encryptionkey@0"
I20260806 20:37:19.968179 17064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "d126604a21704f60ad96e2faa5af73f7"
format_stamp: "Formatted at 2026-08-06 20:37:19 on dist-test-slave-2kcd"
server_key: "1ae686201ff7a561decd99c1945b945f"
server_key_iv: "296f7a2fa24de1189e5ce5c766e18366"
server_key_version: "encryptionkey@0"
I20260806 20:37:19.973799 17064 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260806 20:37:19.977281 17084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:19.978636 17064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:37:19.978782 17064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "d126604a21704f60ad96e2faa5af73f7"
format_stamp: "Formatted at 2026-08-06 20:37:19 on dist-test-slave-2kcd"
server_key: "1ae686201ff7a561decd99c1945b945f"
server_key_iv: "296f7a2fa24de1189e5ce5c766e18366"
server_key_version: "encryptionkey@0"
I20260806 20:37:19.978974 17064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:19.999981 17064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:20.004061 17064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:20.004290 17064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:20.023815 17064 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:38535
I20260806 20:37:20.023846 17154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:38535 every 8 connection(s)
I20260806 20:37:20.025242 17064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:20.026536 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17064
I20260806 20:37:20.026777 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:20.027446 13909 external_mini_cluster.cc:1428] Setting key 30ccac0a35dd8f4bf4e7b3ebbe71be75
I20260806 20:37:20.029368 17157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:20.035835 17157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:20 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:20.060917 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.039023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38535 (local address 127.0.0.1:35826)
0806 20:37:20.039956 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.040016 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:20.042619 (+ 2603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:20.043577 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:20.043582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:20.044174 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:20.044522 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.044540 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.046901 (+ 2361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.046905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.047931 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.047960 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.049422 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.049427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.049582 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.050257 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:20.050283 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:20.052409 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:20.056989 (+ 4580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.056999 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.057008 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.057391 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.057879 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.057881 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.057884 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.058026 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.059019 (+ 993us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:20.059025 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:20.059218 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 20:37:20.059450 (+ 232us) client_negotiation.cc:240] Negotiation successful
0806 20:37:20.059842 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":2,"thread_start_us":384,"threads_started":1}
I20260806 20:37:20.060945 17160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.039023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.13.149.126:38535)
0806 20:37:20.041021 (+ 1998us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:20.041027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:20.041067 (+ 40us) server_negotiation.cc:407] Connection header received
0806 20:37:20.043015 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:20.043025 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:20.043330 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:20.043558 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:20.044736 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.046739 (+ 2003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.048103 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.049211 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.049413 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.052681 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:20.052699 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:20.052718 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:20.052768 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:20.056838 (+ 4070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.057532 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.057544 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.057550 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.057756 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.058139 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.058147 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.058153 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.058847 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:20.059081 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:20.059639 (+ 558us) server_negotiation.cc:299] Negotiation successful
0806 20:37:20.060044 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":114,"server-negotiator.queue_time_us":1796,"spinlock_wait_cycles":48512,"thread_start_us":1546,"threads_started":1}
WARNING: no policy specified for kudu/127.13.149.125@KRBTEST.COM; defaulting to no policy
I20260806 20:37:20.063838 17157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:20.064848 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.064412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60520)
0806 20:37:20.064585 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.064688 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 20:37:20.065135 17088 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.125@KRBTEST.COM" created.
I20260806 20:37:20.066697 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.066344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60522)
0806 20:37:20.066493 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.066559 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 20:37:20.066905 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46441: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab.
Entry for principal kudu/127.13.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab.
I20260806 20:37:20.101780 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:46441
--webserver_interface=127.13.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab
--principal=kudu/127.13.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:38535,127.13.149.125:46441,127.13.149.124:40689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:37:20.116252 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } attempt: 1
I20260806 20:37:20.117571 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.117090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60534)
0806 20:37:20.117295 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.117425 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 20:37:20.118633 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.118244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60538)
0806 20:37:20.118419 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.118491 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 20:37:20.118822 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46441: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
I20260806 20:37:20.187099 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } attempt: 2
I20260806 20:37:20.188285 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.187776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60554)
0806 20:37:20.188040 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.188141 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 20:37:20.189505 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.189132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60566)
0806 20:37:20.189302 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.189370 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 20:37:20.189703 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46441: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
I20260806 20:37:20.280949 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } attempt: 3
I20260806 20:37:20.282092 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.281652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60582)
0806 20:37:20.281853 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.281949 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 20:37:20.283116 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.282762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:60592)
0806 20:37:20.282903 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.282974 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 20:37:20.283288 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46441: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
I20260806 20:37:20.426628 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } attempt: 4
I20260806 20:37:20.428004 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.427426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:42650)
0806 20:37:20.427765 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.427855 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260806 20:37:20.429065 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.428659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:42652)
0806 20:37:20.428858 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.428929 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 20:37:20.429246 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46441: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46441: connect: Connection refused (error 111)
W20260806 20:37:20.452173 17166 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 20:37:20.452566 17166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:20.452702 17166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:20.452885 17166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:20.460307 17166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:20.460454 17166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:20.460563 17166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:20.460654 17166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:20.460747 17166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:20.470917 17166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:38535,127.13.149.125:46441,127.13.149.124:40689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab
--principal=kudu/127.13.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:46441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:20.472353 17166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:20.473793 17166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:20.485975 17174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:20.485936 17175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:20.486016 17177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:20.487138 17166 server_base.cc:1034] running on GCE node
I20260806 20:37:20.487937 17166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:20.489507 17166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:20.490736 17166 hybrid_clock.cc:648] HybridClock initialized: now 1786048640490647 us; error 56 us; skew 500 ppm
I20260806 20:37:20.491041 17166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:20 dist-test-slave-2kcd krb5kdc[17045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048640, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:20.494196 17166 init.cc:377] Logged in from keytab as kudu/127.13.149.125@KRBTEST.COM (short username kudu)
I20260806 20:37:20.495632 17166 webserver.cc:460] Webserver started at http://127.13.149.125:39803/ using document root <none> and password file <none>
I20260806 20:37:20.496294 17166 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:20.496382 17166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:20.496680 17166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:20.499680 17166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data/instance:
uuid: "52c9aacb185041d89fd7adb47d936cd5"
format_stamp: "Formatted at 2026-08-06 20:37:20 on dist-test-slave-2kcd"
server_key: "c72133f24abadcd08898056c923221ab"
server_key_iv: "ef732d64b591ebce157a91f672fb1144"
server_key_version: "encryptionkey@0"
I20260806 20:37:20.500425 17166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/wal/instance:
uuid: "52c9aacb185041d89fd7adb47d936cd5"
format_stamp: "Formatted at 2026-08-06 20:37:20 on dist-test-slave-2kcd"
server_key: "c72133f24abadcd08898056c923221ab"
server_key_iv: "ef732d64b591ebce157a91f672fb1144"
server_key_version: "encryptionkey@0"
I20260806 20:37:20.505545 17166 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 20:37:20.509167 17189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:20.510507 17166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 20:37:20.510658 17166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/wal
uuid: "52c9aacb185041d89fd7adb47d936cd5"
format_stamp: "Formatted at 2026-08-06 20:37:20 on dist-test-slave-2kcd"
server_key: "c72133f24abadcd08898056c923221ab"
server_key_iv: "ef732d64b591ebce157a91f672fb1144"
server_key_version: "encryptionkey@0"
I20260806 20:37:20.510843 17166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:20.555379 17166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:20.559801 17166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:20.560038 17166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:20.579067 17166 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.125:46441
I20260806 20:37:20.579103 17265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.125:46441 every 8 connection(s)
I20260806 20:37:20.580377 17166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
I20260806 20:37:20.584100 17266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:20.586623 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17166
I20260806 20:37:20.586834 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-1/wal/instance
I20260806 20:37:20.587283 13909 external_mini_cluster.cc:1428] Setting key ed0b19d86090f6faa2b22f46b8180b81
I20260806 20:37:20.590860 17266 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:20 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048640, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:20.610988 17268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.593398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56912 (local address 127.13.149.126:38535)
0806 20:37:20.593929 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:20.593933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:20.594905 (+ 972us) server_negotiation.cc:407] Connection header received
0806 20:37:20.596830 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:20.596836 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:20.596943 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:20.597070 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:20.598573 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.599333 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.600871 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.601280 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.601427 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.604842 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:20.604856 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:20.604866 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:20.604901 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:20.607728 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.608462 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.608469 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.608472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.608624 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.609181 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.609184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.609186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.609446 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:20.609576 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:20.610547 (+ 971us) server_negotiation.cc:299] Negotiation successful
0806 20:37:20.610706 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":291,"threads_started":1}
I20260806 20:37:20.612438 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.593996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38535 (local address 127.0.0.1:56912)
0806 20:37:20.594723 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.594768 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:20.596542 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:20.597313 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:20.597321 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:20.597817 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:20.598346 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.598374 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.599517 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.599521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.600679 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.600691 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.601515 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.601522 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.601753 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.602446 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:20.602467 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:20.604579 (+ 2112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:20.607863 (+ 3284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.607879 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.607892 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.608331 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.608806 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.608815 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.608821 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.609053 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.609598 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:20.609611 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:20.610147 (+ 536us) client_negotiation.cc:769] Sending connection context
0806 20:37:20.610466 (+ 319us) client_negotiation.cc:240] Negotiation successful
0806 20:37:20.610999 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":307,"threads_started":1}
I20260806 20:37:20.614374 17266 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.149.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.124@KRBTEST.COM" created.
Aug 06 20:37:20 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048640, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:37:20.631498 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.615176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:42668)
0806 20:37:20.615393 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.615422 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:20.615549 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:20.616376 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:20.616379 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:20.616859 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:20.617005 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.617013 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.619224 (+ 2211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.619228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.620077 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.620088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.621374 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.621379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.621515 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.622021 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:20.622037 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:20.624884 (+ 2847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:20.629192 (+ 4308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.629196 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.629199 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.629570 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.629974 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.629978 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.629980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.630106 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.630832 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:20.630837 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:20.630954 (+ 117us) client_negotiation.cc:769] Sending connection context
0806 20:37:20.631063 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 20:37:20.631244 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 20:37:20.632011 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.615238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42668 (local address 127.13.149.125:46441)
0806 20:37:20.615871 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:20.615881 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:20.615914 (+ 33us) server_negotiation.cc:407] Connection header received
0806 20:37:20.615969 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:20.615978 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:20.616199 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:20.616369 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:20.617203 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.619051 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.620231 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.621207 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.621350 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.625129 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:20.625145 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:20.625164 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:20.625208 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:20.629040 (+ 3832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.629703 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.629714 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.629720 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.629862 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.630212 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.630219 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.630225 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.630703 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:20.630923 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:20.631246 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 20:37:20.631530 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":271,"threads_started":1}
I20260806 20:37:20.634622 17266 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:20.635726 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.635189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46526)
0806 20:37:20.635395 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.635534 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 20:37:20.636014 17193 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.637639 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.637273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46542)
0806 20:37:20.637463 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.637548 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:37:20.637890 17266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab.
Entry for principal kudu/127.13.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab.
I20260806 20:37:20.661397 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:40689
--webserver_interface=127.13.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab
--principal=kudu/127.13.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:37705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:38535,127.13.149.125:46441,127.13.149.124:40689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:37:20.687147 17266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 1
I20260806 20:37:20.688323 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.687884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46550)
0806 20:37:20.688080 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.688179 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 20:37:20.689505 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.688998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46558)
0806 20:37:20.689221 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.689330 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:37:20.689826 17266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.728581 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } attempt: 5
Aug 06 20:37:20 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:37:20.743417 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.729397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:42680)
0806 20:37:20.729626 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.729649 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:20.729792 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:20.730215 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:20.730218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:20.730592 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:20.730750 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.730758 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.732197 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.732201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.733122 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:20.733135 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.734194 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.734202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:20.734451 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.735163 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:20.735181 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:20.737243 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:20.741120 (+ 3877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.741124 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.741127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.741512 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.741933 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:20.741936 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:20.741939 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:20.742083 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:20.742690 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:20.742693 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:20.742814 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 20:37:20.742930 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 20:37:20.743162 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 20:37:20.743652 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.729599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42680 (local address 127.13.149.125:46441)
0806 20:37:20.729823 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:20.729829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:20.729874 (+ 45us) server_negotiation.cc:407] Connection header received
0806 20:37:20.729961 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:20.729967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:20.730069 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:20.730179 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:20.730918 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.732015 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.733271 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:20.733991 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:20.734147 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:20.737460 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:20.737466 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:20.737471 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:20.737510 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:20.740948 (+ 3438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.741637 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.741642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.741646 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.741797 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:20.742196 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:20.742201 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:20.742204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:20.742574 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:20.742725 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:20.743078 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 20:37:20.743307 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 20:37:20.744735 17157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:20.745770 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.745378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46574)
0806 20:37:20.745547 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.745640 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 20:37:20.746717 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.746377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46580)
0806 20:37:20.746544 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.746606 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 20:37:20.746948 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.758056 17266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 2
I20260806 20:37:20.759085 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.758643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46592)
0806 20:37:20.758827 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.758929 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 20:37:20.760092 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.759745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46598)
0806 20:37:20.759900 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.759965 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 20:37:20.760295 17266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.798276 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 1
I20260806 20:37:20.799577 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.798965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46610)
0806 20:37:20.799231 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.799359 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260806 20:37:20.800630 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.800241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46616)
0806 20:37:20.800402 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.800489 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 20:37:20.800875 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.851531 17266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 3
I20260806 20:37:20.852736 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.852260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46618)
0806 20:37:20.852470 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.852572 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 20:37:20.853878 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.853455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46626)
0806 20:37:20.853695 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.853767 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260806 20:37:20.854152 17266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.869115 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 2
I20260806 20:37:20.870520 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.869852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46634)
0806 20:37:20.870129 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.870260 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 20:37:20.871723 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.871263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46650)
0806 20:37:20.871458 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.871562 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:37:20.871954 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.978196 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 3
I20260806 20:37:20.979641 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.978941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46656)
0806 20:37:20.979236 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.979374 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260806 20:37:20.980810 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.980376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46668)
0806 20:37:20.980548 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.980644 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 20:37:20.981052 17157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
I20260806 20:37:20.997376 17266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 4
I20260806 20:37:20.998517 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.998061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46670)
0806 20:37:20.998276 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.998371 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 20:37:20.999614 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:20.999255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46676)
0806 20:37:20.999416 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:20.999506 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 20:37:20.999890 17266 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:40689: Network error: Client connection negotiation failed: client connection to 127.13.149.124:40689: connect: Connection refused (error 111)
W20260806 20:37:21.014448 17278 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 20:37:21.014802 17278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:21.014911 17278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:21.015045 17278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:21.022591 17278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:21.022680 17278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:21.022827 17278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:21.022907 17278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:21.023046 17278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:21.037087 17278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:37705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:38535,127.13.149.125:46441,127.13.149.124:40689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab
--principal=kudu/127.13.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:40689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:21.038198 17278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:21.039422 17278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:21.051313 17283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:21.051406 17289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:21.051347 17286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:21.052470 17278 server_base.cc:1034] running on GCE node
I20260806 20:37:21.053237 17278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:21.054558 17278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:21.055780 17278 hybrid_clock.cc:648] HybridClock initialized: now 1786048641055715 us; error 38 us; skew 500 ppm
I20260806 20:37:21.056118 17278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048641, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:21.059568 17278 init.cc:377] Logged in from keytab as kudu/127.13.149.124@KRBTEST.COM (short username kudu)
I20260806 20:37:21.061118 17278 webserver.cc:460] Webserver started at http://127.13.149.124:43035/ using document root <none> and password file <none>
I20260806 20:37:21.061797 17278 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:21.061931 17278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:21.062254 17278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:21.065357 17278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data/instance:
uuid: "952f65188dcc45069271f240aa0e4fea"
format_stamp: "Formatted at 2026-08-06 20:37:21 on dist-test-slave-2kcd"
server_key: "169c6aee63f705d5690a481d708142bc"
server_key_iv: "fc158de6960fe79bf94060e49df556cd"
server_key_version: "encryptionkey@0"
I20260806 20:37:21.066162 17278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/wal/instance:
uuid: "952f65188dcc45069271f240aa0e4fea"
format_stamp: "Formatted at 2026-08-06 20:37:21 on dist-test-slave-2kcd"
server_key: "169c6aee63f705d5690a481d708142bc"
server_key_iv: "fc158de6960fe79bf94060e49df556cd"
server_key_version: "encryptionkey@0"
I20260806 20:37:21.071277 17278 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 20:37:21.074683 17298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:21.075974 17278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 20:37:21.076164 17278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/wal
uuid: "952f65188dcc45069271f240aa0e4fea"
format_stamp: "Formatted at 2026-08-06 20:37:21 on dist-test-slave-2kcd"
server_key: "169c6aee63f705d5690a481d708142bc"
server_key_iv: "fc158de6960fe79bf94060e49df556cd"
server_key_version: "encryptionkey@0"
I20260806 20:37:21.076380 17278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:21.100324 17278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:21.104918 17278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:21.105226 17278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:21.124439 17278 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.124:40689
I20260806 20:37:21.124475 17382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.124:40689 every 8 connection(s)
I20260806 20:37:21.125847 17278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
I20260806 20:37:21.129592 17384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:21.131955 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17278
I20260806 20:37:21.132157 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786048265930148-13909-0/minicluster-data/master-2/wal/instance
I20260806 20:37:21.132620 13909 external_mini_cluster.cc:1428] Setting key 3cb640c449dd2fff432062375aab6896
I20260806 20:37:21.137312 17384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048641, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:21.156013 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.140149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56928 (local address 127.13.149.126:38535)
0806 20:37:21.140623 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.140630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.141205 (+ 575us) server_negotiation.cc:407] Connection header received
0806 20:37:21.141406 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.141412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.141494 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.141616 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.143051 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.143992 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.145895 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.146294 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.146390 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.150372 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.150377 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.150381 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.150419 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.153146 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.153862 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.153867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.153869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.154003 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.154400 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.154404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.154406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.154672 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.154856 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.155345 (+ 489us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.155569 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":247,"threads_started":1}
I20260806 20:37:21.156605 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.134646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46678 (local address 127.13.149.124:40689)
0806 20:37:21.135501 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.135512 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.135553 (+ 41us) server_negotiation.cc:407] Connection header received
0806 20:37:21.137254 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.137276 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.137633 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.137959 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.139805 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.141796 (+ 1991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.143469 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.144389 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.144512 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.149453 (+ 4941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.149470 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.149486 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.149525 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.152658 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.153364 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.153385 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.153388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.153552 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.153947 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.153953 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.153956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.154412 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.154744 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.155153 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.155544 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":649,"thread_start_us":410,"threads_started":1}
I20260806 20:37:21.156652 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.140208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:38535 (local address 127.0.0.1:56928)
0806 20:37:21.141058 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:21.141093 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:21.141273 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:21.141673 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:21.141681 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:21.142545 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:21.142879 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.142891 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.144157 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.144161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.145735 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.145750 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.146554 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.146564 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.146783 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.147435 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:21.147469 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:21.150162 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:21.153284 (+ 3122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.153295 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.153306 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.153715 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.154126 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.154130 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.154134 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.154269 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.154809 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:21.154817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:21.155031 (+ 214us) client_negotiation.cc:769] Sending connection context
0806 20:37:21.155230 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 20:37:21.155764 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":5,"thread_start_us":461,"threads_started":1}
I20260806 20:37:21.158258 17384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:21.158274 17157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 4
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048641, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:21.174674 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.159666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46692 (local address 127.13.149.124:40689)
0806 20:37:21.159820 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.159825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.159839 (+ 14us) server_negotiation.cc:407] Connection header received
0806 20:37:21.159874 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.159880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.159946 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.160069 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.161075 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.162171 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.163880 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.164585 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.164716 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.168682 (+ 3966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.168691 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.168695 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.168737 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.171598 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.172549 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.172557 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.172561 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.172693 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.173228 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.173234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.173237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.173518 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.173666 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.174064 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.174285 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":49}
I20260806 20:37:21.174710 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.158808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46692)
0806 20:37:21.158993 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:21.159013 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:21.159119 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:21.160125 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:21.160130 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:21.160653 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:21.160931 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.160943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.162326 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.162331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.163727 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.163742 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.165144 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.165150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.165451 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.166143 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:21.166172 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:21.168448 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:21.171753 (+ 3305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.171758 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.171762 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.172373 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.172876 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.172881 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.172884 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.173112 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.173639 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:21.173644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:21.173818 (+ 174us) client_negotiation.cc:769] Sending connection context
0806 20:37:21.173978 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 20:37:21.174289 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":1}
I20260806 20:37:21.175001 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.159237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42692 (local address 127.13.149.125:46441)
0806 20:37:21.159443 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.159449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.159466 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:37:21.159564 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.159568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.159645 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.159741 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.160674 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.161589 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.163158 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.163774 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.163921 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.168102 (+ 4181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.168111 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.168116 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.168159 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.171783 (+ 3624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.172499 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.172505 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.172509 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.172664 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.173118 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.173125 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.173129 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.173515 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.173674 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.174377 (+ 703us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.174599 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 20:37:21.175547 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.159088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46441 (local address 127.0.0.1:42692)
0806 20:37:21.159237 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:21.159255 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:21.159350 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:21.159834 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:21.159839 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:21.160303 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:21.160490 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.160501 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.161728 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.161734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.162991 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.163005 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.164118 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.164127 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.164434 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.165132 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:21.165153 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:21.167885 (+ 2732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:21.171932 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.171939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.171944 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.172351 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.172814 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.172822 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.172825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.173006 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.173744 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:21.173749 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:21.173916 (+ 167us) client_negotiation.cc:769] Sending connection context
0806 20:37:21.174090 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 20:37:21.175344 (+ 1254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":1017}
I20260806 20:37:21.176685 17384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:21.179071 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.160660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56940 (local address 127.13.149.126:38535)
0806 20:37:21.160876 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.160882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.160897 (+ 15us) server_negotiation.cc:407] Connection header received
0806 20:37:21.160941 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.160945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.161036 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.161133 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.162557 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.163405 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.164775 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.165450 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.165595 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.171146 (+ 5551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.171153 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.171157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.171197 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.174846 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.175762 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.175770 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.175776 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.175918 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.176540 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.176545 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.176548 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.176926 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.177195 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.178460 (+ 1265us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.178682 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":57}
I20260806 20:37:21.182386 17157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7: Bootstrap starting.
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048641, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
I20260806 20:37:21.185985 17157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:21.187071 17157 log.cc:824] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:21.190047 17157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7: No bootstrap required, opened a new log
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:37:21.192566 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.177369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46696)
0806 20:37:21.177529 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:21.177546 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:21.177637 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:21.178029 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:21.178033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:21.178389 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:21.178520 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.178528 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.179738 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.179745 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.181177 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.181193 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.182127 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.182134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.182378 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.182985 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:21.183013 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:21.185666 (+ 2653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:21.189605 (+ 3939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.189610 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.189615 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.190119 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.190573 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.190577 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.190580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.190755 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.191517 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:21.191521 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:21.191670 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 20:37:21.191811 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 20:37:21.192150 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":1}
I20260806 20:37:21.192612 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.177663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46696 (local address 127.13.149.124:40689)
0806 20:37:21.177806 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.177810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.177821 (+ 11us) server_negotiation.cc:407] Connection header received
0806 20:37:21.177853 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.177855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.177899 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.178005 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.178646 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.179534 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.181340 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.181976 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.182110 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.185851 (+ 3741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.185857 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.185862 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.185898 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.189462 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.190262 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.190269 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.190272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.190433 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.190917 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.190923 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.190927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.191382 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.191563 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.191907 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.192280 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":174,"server-negotiator.queue_time_us":50}
I20260806 20:37:21.198487 17384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: Bootstrap starting.
I20260806 20:37:21.199600 17157 raft_consensus.cc:348] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.199960 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.181067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42696 (local address 127.13.149.125:46441)
0806 20:37:21.181307 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.181314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.181522 (+ 208us) server_negotiation.cc:407] Connection header received
0806 20:37:21.181684 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.181689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.181757 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.181855 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.184029 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.184944 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.186382 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.187382 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.187505 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.193308 (+ 5803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.193314 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.193319 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.193357 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.196911 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.197763 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.197770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.197776 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.197940 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.198384 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.198389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.198392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.198761 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.199044 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.199369 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.199618 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260806 20:37:21.200022 17157 raft_consensus.cc:729] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d126604a21704f60ad96e2faa5af73f7, State: Initialized, Role: FOLLOWER
I20260806 20:37:21.200554 17157 consensus_queue.cc:260] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.202502 17384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:21.203727 17384 log.cc:824] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:21.206144 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:21.207052 17384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: No bootstrap required, opened a new log
I20260806 20:37:21.207533 17392 sys_catalog.cc:455] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.207867 17392 sys_catalog.cc:458] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:21.209385 17157 sys_catalog.cc:564] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:21.209717 17125 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d126604a21704f60ad96e2faa5af73f7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56940
I20260806 20:37:21.210107 17125 raft_consensus.cc:482] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 20:37:21.210304 17125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:21.213982 17125 raft_consensus.cc:504] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.215541 17125 leader_election.cc:288] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [CANDIDATE]: Term 1 election: Requested vote from peers 52c9aacb185041d89fd7adb47d936cd5 (127.13.149.125:46441), 952f65188dcc45069271f240aa0e4fea (127.13.149.124:40689)
I20260806 20:37:21.218343 17384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.218794 17384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952f65188dcc45069271f240aa0e4fea, State: Initialized, Role: FOLLOWER
I20260806 20:37:21.219347 17384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.220594 17406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.221244 17406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:21.221935 17384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:21.222010 17339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d126604a21704f60ad96e2faa5af73f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "952f65188dcc45069271f240aa0e4fea"
I20260806 20:37:21.222520 17339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:21.226866 17339 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d126604a21704f60ad96e2faa5af73f7 in term 1.
I20260806 20:37:21.227661 17088 leader_election.cc:302] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 952f65188dcc45069271f240aa0e4fea, d126604a21704f60ad96e2faa5af73f7; no voters:
I20260806 20:37:21.228260 17392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:21.229004 17392 raft_consensus.cc:686] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [term 1 LEADER]: Becoming Leader. State: Replica: d126604a21704f60ad96e2faa5af73f7, State: Running, Role: LEADER
I20260806 20:37:21.229717 17392 consensus_queue.cc:237] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.233932 17418 sys_catalog.cc:455] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d126604a21704f60ad96e2faa5af73f7. Latest consensus state: current_term: 1 leader_uuid: "d126604a21704f60ad96e2faa5af73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.234421 17418 sys_catalog.cc:458] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:21.246419 17423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:21.257119 17423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260806 20:37:21.264267 17090 tablet.cc:2369] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:37:21.289696 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.239250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56952 (local address 127.13.149.126:38535)
0806 20:37:21.239486 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.239495 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.251565 (+ 12070us) server_negotiation.cc:407] Connection header received
0806 20:37:21.252613 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.252619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.252708 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.252811 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.261460 (+ 8649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.262906 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.269680 (+ 6774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.270580 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.270688 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.278202 (+ 7514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.278212 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.278220 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.278274 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.283800 (+ 5526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.285284 (+ 1484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.285319 (+ 35us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.285330 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.285610 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.286427 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.286461 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.286465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.287071 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.287522 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.288487 (+ 965us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.288962 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 20:37:21.299094 17266 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } attempt: 5
I20260806 20:37:21.305217 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.246602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.13.149.125:46441)
0806 20:37:21.246868 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.246877 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.253661 (+ 6784us) server_negotiation.cc:407] Connection header received
0806 20:37:21.254084 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.254093 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.254182 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.254266 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.258158 (+ 3892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.259596 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.267655 (+ 8059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.268549 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.268694 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.291696 (+ 23002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.291705 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.291711 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.291760 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.295546 (+ 3786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.301724 (+ 6178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.301732 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.301737 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.301921 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.302647 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.302654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.302658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.303065 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.303306 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.304247 (+ 941us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.304665 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
W20260806 20:37:21.306123 17445 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:37:21.306269 17445 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:37:21.292872 17064 master_runner.cc:186] Error getting master registration for 127.13.149.125:46441: OK, instance_id { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" instance_seqno: 1786048640573594 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 20:37:21.310976 17064 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 20:37:21.311529 17339 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [term 1 FOLLOWER]: Refusing update from remote peer d126604a21704f60ad96e2faa5af73f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:37:21.312557 17418 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:37:21.289134 17278 master_runner.cc:186] Error getting master registration for 127.13.149.125:46441: OK, instance_id { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" instance_seqno: 1786048640573594 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 20:37:21.313410 17278 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 20:37:21.316318 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.252866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46708 (local address 127.13.149.124:40689)
0806 20:37:21.253082 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.253091 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.271322 (+ 18231us) server_negotiation.cc:407] Connection header received
0806 20:37:21.271648 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.271656 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.272149 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.272294 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.275200 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.276631 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.285016 (+ 8385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.285995 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.286122 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.301867 (+ 15745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.301877 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.301885 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.301941 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.306920 (+ 4979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.308081 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.308087 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.308091 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.308382 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.313847 (+ 5465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.313853 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.313856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.314210 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.314459 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.315589 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.315954 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 20:37:21 dist-test-slave-2kcd krb5kdc[17045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048640, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
I20260806 20:37:21.329775 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.299641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:40689 (local address 127.0.0.1:46724)
0806 20:37:21.300008 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:21.300029 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:21.300140 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:21.312092 (+ 11952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:21.312098 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:21.312591 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:21.312829 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.312844 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.314732 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.314739 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.316140 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:21.316155 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.317544 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.317550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:21.317768 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.318503 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:21.318525 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:21.321468 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:21.325961 (+ 4493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.325999 (+ 38us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.326003 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.326801 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.327484 (+ 683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:21.327490 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:21.327493 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:21.327818 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:21.328736 (+ 918us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:21.328742 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:21.328937 (+ 195us) client_negotiation.cc:769] Sending connection context
0806 20:37:21.329116 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 20:37:21.329398 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260806 20:37:21.332645 17448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.300357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46724 (local address 127.13.149.124:40689)
0806 20:37:21.311631 (+ 11274us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.311640 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.311664 (+ 24us) server_negotiation.cc:407] Connection header received
0806 20:37:21.311718 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.311723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.311804 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.313006 (+ 1202us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.313339 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.314611 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.316548 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.317360 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.318101 (+ 741us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.321793 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:21.321802 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:21.321808 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:21.321853 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:21.325787 (+ 3934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.326966 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.326972 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.327004 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.327254 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:21.328022 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:21.328031 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:21.328039 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:21.328485 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:21.328652 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.329497 (+ 845us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.330126 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11113,"thread_start_us":11548,"threads_started":1}
I20260806 20:37:21.338646 17266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5: Bootstrap starting.
I20260806 20:37:21.342617 17266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:21.343398 17406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [sys.catalog]: SysCatalogTable state changed. Reason: New leader d126604a21704f60ad96e2faa5af73f7. Latest consensus state: current_term: 1 leader_uuid: "d126604a21704f60ad96e2faa5af73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.343708 17406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:21.343927 17266 log.cc:824] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:21.351773 17440 mvcc.cc:205] Tried to move back new op lower bound from 7315655234720411648 to 7315655234483273728. Current Snapshot: MvccSnapshot[applied={T|T < 7315655234720411648}]
I20260806 20:37:21.364289 17406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d126604a21704f60ad96e2faa5af73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.364540 17406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:21.367020 17266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5: No bootstrap required, opened a new log
I20260806 20:37:21.371196 17392 sys_catalog.cc:455] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d126604a21704f60ad96e2faa5af73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.371685 17392 sys_catalog.cc:458] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:21.380954 17266 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.381474 17266 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52c9aacb185041d89fd7adb47d936cd5, State: Initialized, Role: FOLLOWER
I20260806 20:37:21.382098 17266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } }
I20260806 20:37:21.384505 17423 catalog_manager.cc:1347] Generated new cluster ID: abe0c856839c4d068166a8a75b850233
I20260806 20:37:21.384609 17423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:21.393245 17457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.393615 17457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:21.398514 17266 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:21.398953 17220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:21.400981 17221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d126604a21704f60ad96e2faa5af73f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "52c9aacb185041d89fd7adb47d936cd5"
I20260806 20:37:21.405457 17423 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:21.406003 17220 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [term 1 FOLLOWER]: Refusing update from remote peer d126604a21704f60ad96e2faa5af73f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:37:21.407348 17423 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:21.412457 17221 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d126604a21704f60ad96e2faa5af73f7 in term 1.
I20260806 20:37:21.414372 17392 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:37:21.435938 17423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7: Generated new TSK 0
I20260806 20:37:21.437150 17423 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:21.460570 17457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d126604a21704f60ad96e2faa5af73f7. Latest consensus state: current_term: 1 leader_uuid: "d126604a21704f60ad96e2faa5af73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.460992 17457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:21.461433 17466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d126604a21704f60ad96e2faa5af73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.461902 17466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:21.463201 17392 sys_catalog.cc:455] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d126604a21704f60ad96e2faa5af73f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d126604a21704f60ad96e2faa5af73f7" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 38535 } } peers { permanent_uuid: "52c9aacb185041d89fd7adb47d936cd5" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46441 } } peers { permanent_uuid: "952f65188dcc45069271f240aa0e4fea" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 40689 } } }
I20260806 20:37:21.463495 17392 sys_catalog.cc:458] T 00000000000000000000000000000000 P d126604a21704f60ad96e2faa5af73f7 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:21.523972 17485 catalog_manager.cc:1259] Loaded cluster ID: abe0c856839c4d068166a8a75b850233
I20260806 20:37:21.524161 17485 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5: loading cluster ID for follower catalog manager: success
I20260806 20:37:21.528028 17485 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5: acquiring CA information for follower catalog manager: success
I20260806 20:37:21.543772 17485 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 52c9aacb185041d89fd7adb47d936cd5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 20:37:21.613131 17275 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.601936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42712 (local address 127.13.149.125:46441)
0806 20:37:21.602145 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.602152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.608725 (+ 6573us) server_negotiation.cc:407] Connection header received
0806 20:37:21.611589 (+ 2864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.611596 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.611695 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.611770 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.612886 (+ 1116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42712: BlockingRecv error: recv got EOF from 127.0.0.1:42712 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 20:37:21.614835 17388 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.598065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56956 (local address 127.13.149.126:38535)
0806 20:37:21.598318 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.598335 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.607499 (+ 9164us) server_negotiation.cc:407] Connection header received
0806 20:37:21.609137 (+ 1638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.609144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.609239 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.609321 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.614584 (+ 5263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56956: BlockingRecv error: recv got EOF from 127.0.0.1:56956 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260806 20:37:21.616824 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.606815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46736 (local address 127.13.149.124:40689)
0806 20:37:21.607011 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.607017 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.611169 (+ 4152us) server_negotiation.cc:407] Connection header received
0806 20:37:21.613848 (+ 2679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.613853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.613965 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.614045 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.616578 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46736: BlockingRecv error: recv got EOF from 127.0.0.1:46736 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:37:21.663870 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.650625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42720 (local address 127.13.149.125:46441)
0806 20:37:21.650829 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.650835 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.655749 (+ 4914us) server_negotiation.cc:407] Connection header received
0806 20:37:21.656294 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.656302 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.656534 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.656689 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:21.657411 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.658589 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.660656 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.661352 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.661463 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.662281 (+ 818us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:21.662985 (+ 704us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:21.663108 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.663384 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.663494 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 20:37:21.704537 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.694762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46752 (local address 127.13.149.124:40689)
0806 20:37:21.694955 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.694962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.702172 (+ 7210us) server_negotiation.cc:407] Connection header received
0806 20:37:21.702766 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.702773 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.702908 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.702998 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.704217 (+ 1219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46752: BlockingRecv error: recv got EOF from 127.0.0.1:46752 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:37:21.751703 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.737221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42736 (local address 127.13.149.125:46441)
0806 20:37:21.737447 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.737453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.744293 (+ 6840us) server_negotiation.cc:407] Connection header received
0806 20:37:21.744907 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.744914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.745048 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.745129 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:21.745894 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.747134 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.749317 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.750050 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.750152 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.750792 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:21.750949 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:21.751035 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.751276 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.751383 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260806 20:37:21.795256 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.786043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46758 (local address 127.13.149.124:40689)
0806 20:37:21.786270 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.786280 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.793140 (+ 6860us) server_negotiation.cc:407] Connection header received
0806 20:37:21.793676 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.793684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.793782 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.793872 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.795006 (+ 1134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46758: BlockingRecv error: recv got EOF from 127.0.0.1:46758 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 20:37:21.848958 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.834681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42748 (local address 127.13.149.125:46441)
0806 20:37:21.834872 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.834879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.841833 (+ 6954us) server_negotiation.cc:407] Connection header received
0806 20:37:21.842400 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.842406 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.842498 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.842573 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:21.843277 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.844386 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.846516 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.847130 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.847240 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.847959 (+ 719us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:21.848127 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:21.848200 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.848468 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.848577 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 20:37:21.895051 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.885794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46766 (local address 127.13.149.124:40689)
0806 20:37:21.885965 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.885972 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.892869 (+ 6897us) server_negotiation.cc:407] Connection header received
0806 20:37:21.893420 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.893427 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.893558 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.893643 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.894791 (+ 1148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46766: BlockingRecv error: recv got EOF from 127.0.0.1:46766 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:37:21.951946 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.935950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.13.149.125:46441)
0806 20:37:21.936204 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.936210 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.944998 (+ 8788us) server_negotiation.cc:407] Connection header received
0806 20:37:21.945259 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.945265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.945378 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.945506 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:21.946084 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.947379 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.949676 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.950427 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.950565 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.951081 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:21.951220 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:21.951308 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.951555 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.951650 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
W20260806 20:37:21.974956 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.972418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46782 (local address 127.13.149.124:40689)
0806 20:37:21.972641 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.972648 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.973168 (+ 520us) server_negotiation.cc:407] Connection header received
0806 20:37:21.973461 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.973468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.973561 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.973632 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:21.974707 (+ 1075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46782: BlockingRecv error: recv got EOF from 127.0.0.1:46782 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 20:37:21.993414 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:21.987305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42766 (local address 127.13.149.125:46441)
0806 20:37:21.987517 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.987523 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:21.988028 (+ 505us) server_negotiation.cc:407] Connection header received
0806 20:37:21.988213 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:21.988220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:21.988313 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:21.988420 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:21.988918 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.990074 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.991353 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:21.992043 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:21.992170 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:21.992547 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:21.992699 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:21.992824 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:21.992988 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 20:37:21.993068 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260806 20:37:22.001618 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:21.999475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46784 (local address 127.13.149.124:40689)
0806 20:37:21.999676 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:21.999682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.000099 (+ 417us) server_negotiation.cc:407] Connection header received
0806 20:37:22.000277 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.000282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.000382 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.000511 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:22.001374 (+ 863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46784: BlockingRecv error: recv got EOF from 127.0.0.1:46784 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 20:37:22.030646 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.023526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.13.149.125:46441)
0806 20:37:22.023761 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.023767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.024322 (+ 555us) server_negotiation.cc:407] Connection header received
0806 20:37:22.024514 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.024520 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.024601 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.024694 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.025243 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.026464 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.028532 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.029254 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.029383 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.029873 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.030008 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.030093 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.030276 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.030370 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260806 20:37:22.054222 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:22.050452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46794 (local address 127.13.149.124:40689)
0806 20:37:22.050629 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.050635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.052732 (+ 2097us) server_negotiation.cc:407] Connection header received
0806 20:37:22.052962 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.052967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.053039 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.053155 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:22.053986 (+ 831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46794: BlockingRecv error: recv got EOF from 127.0.0.1:46794 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 20:37:22.095321 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.089988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42784 (local address 127.13.149.125:46441)
0806 20:37:22.090245 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.090253 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.090604 (+ 351us) server_negotiation.cc:407] Connection header received
0806 20:37:22.090841 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.090846 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.090934 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.091042 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.091471 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.092196 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.093548 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.094032 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.094169 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.094569 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.094675 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.094778 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.094938 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.095020 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 20:37:22.103154 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:22.101268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46802 (local address 127.13.149.124:40689)
0806 20:37:22.101493 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.101501 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.101740 (+ 239us) server_negotiation.cc:407] Connection header received
0806 20:37:22.101952 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.101956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.102047 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.102162 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:22.102894 (+ 732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46802: BlockingRecv error: recv got EOF from 127.0.0.1:46802 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 20:37:22.175478 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.170759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42798 (local address 127.13.149.125:46441)
0806 20:37:22.170985 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.170989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.171249 (+ 260us) server_negotiation.cc:407] Connection header received
0806 20:37:22.171441 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.171445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.171516 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.171608 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.171990 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.172716 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.174031 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.174420 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.174515 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.174894 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.175018 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.175085 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.175217 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.175278 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 20:37:22.183245 17448 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:22.181387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46810 (local address 127.13.149.124:40689)
0806 20:37:22.181557 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.181561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.181935 (+ 374us) server_negotiation.cc:407] Connection header received
0806 20:37:22.182083 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.182087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.182178 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.182296 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:22.183075 (+ 779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46810: BlockingRecv error: recv got EOF from 127.0.0.1:46810 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 20:37:22.308315 17445 catalog_manager.cc:1259] Loaded cluster ID: abe0c856839c4d068166a8a75b850233
I20260806 20:37:22.308418 17445 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: loading cluster ID for follower catalog manager: success
I20260806 20:37:22.310992 17445 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: acquiring CA information for follower catalog manager: success
I20260806 20:37:22.312839 17445 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 952f65188dcc45069271f240aa0e4fea: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 20:37:22.319633 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.314732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42802 (local address 127.13.149.125:46441)
0806 20:37:22.314987 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.314992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.315403 (+ 411us) server_negotiation.cc:407] Connection header received
0806 20:37:22.315554 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.315558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.315624 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.315715 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.316107 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.316763 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.318082 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.318494 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.318583 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.318959 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.319061 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.319125 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.319268 (+ 143us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.319329 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 20:37:22.330614 17448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.325345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46822 (local address 127.13.149.124:40689)
0806 20:37:22.325571 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.325577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.325849 (+ 272us) server_negotiation.cc:407] Connection header received
0806 20:37:22.325991 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.325995 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.326113 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.326205 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.326567 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.327256 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.328601 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.329073 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.329167 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.329605 (+ 438us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.330066 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.330172 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.330248 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.330306 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 20:37:22.344403 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.336773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42812 (local address 127.13.149.125:46441)
0806 20:37:22.336996 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.337003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.337995 (+ 992us) server_negotiation.cc:407] Connection header received
0806 20:37:22.338325 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.338334 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.338442 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.338518 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.339552 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.340579 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.342288 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.342993 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.343125 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.343668 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.343771 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.343871 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.344040 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.344132 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 20:37:22.345547 17647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.336675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56962 (local address 127.13.149.126:38535)
0806 20:37:22.337394 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.337403 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.337716 (+ 313us) server_negotiation.cc:407] Connection header received
0806 20:37:22.338403 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.338407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.338543 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.338717 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.339286 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.340381 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.342799 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.343349 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.343479 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.344419 (+ 940us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.344834 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.344943 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.345176 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.345257 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":420,"threads_started":1}
I20260806 20:37:22.346436 17448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:22.338130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46832 (local address 127.13.149.124:40689)
0806 20:37:22.338272 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:22.338279 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:22.340065 (+ 1786us) server_negotiation.cc:407] Connection header received
0806 20:37:22.340256 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:22.340261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:22.340339 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:22.340439 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:22.341193 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.342284 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.344177 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:22.344784 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:22.344947 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:22.345397 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:22.345531 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:22.345605 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:22.346066 (+ 461us) server_negotiation.cc:299] Negotiation successful
0806 20:37:22.346135 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:37:22.350399 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17064
I20260806 20:37:22.351392 17150 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:22.462749 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17064
W20260806 20:37:22.493620 17299 connection.cc:535] server connection from 127.0.0.1:46692 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 20:37:22.493620 17190 connection.cc:535] server connection from 127.0.0.1:42680 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 20:37:22.494251 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17166
I20260806 20:37:22.495446 17258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:22.602977 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17166
I20260806 20:37:22.627488 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17278
I20260806 20:37:22.628674 17375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:22.737877 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17278
2026-08-06T20:37:22Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4880 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 20:37:22 dist-test-slave-2kcd krb5kdc[17661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 20:37:22 dist-test-slave-2kcd krb5kdc[17661](info): set up 2 sockets
Aug 06 20:37:22 dist-test-slave-2kcd krb5kdc[17661](info): commencing operation
krb5kdc: starting...
W20260806 20:37:24.093971 13909 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.004s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/test-user.keytab.
Aug 06 20:37:24 dist-test-slave-2kcd krb5kdc[17661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T20:37:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T20:37:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
Entry for principal kudu/127.13.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab.
I20260806 20:37:24.416326 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:39489
--webserver_interface=127.13.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:39489,127.13.149.125:46117,127.13.149.124:46231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 20:37:24.788734 17685 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 20:37:24.789235 17685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:24.789397 17685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:24.789526 17685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:24.797220 17685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:24.797317 17685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:24.797458 17685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:24.797549 17685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:24.797681 17685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:24.807964 17685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:39489,127.13.149.125:46117,127.13.149.124:46231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.126.keytab
--principal=kudu/127.13.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.126:39489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:24.809433 17685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:24.810920 17685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:24.823704 17693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:24.824350 17691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:24.824420 17690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:24.825202 17685 server_base.cc:1034] running on GCE node
I20260806 20:37:24.826093 17685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:24.827546 17685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:24.828832 17685 hybrid_clock.cc:648] HybridClock initialized: now 1786048644828708 us; error 39 us; skew 500 ppm
I20260806 20:37:24.829217 17685 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:24 dist-test-slave-2kcd krb5kdc[17661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:24.832584 17685 init.cc:377] Logged in from keytab as kudu/127.13.149.126@KRBTEST.COM (short username kudu)
I20260806 20:37:24.834074 17685 webserver.cc:460] Webserver started at http://127.13.149.126:46685/ using document root <none> and password file <none>
I20260806 20:37:24.834767 17685 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:24.834856 17685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:24.835135 17685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:24.838284 17685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data/instance:
uuid: "ca732f0c9d734110a6f3a941f8b28aa0"
format_stamp: "Formatted at 2026-08-06 20:37:24 on dist-test-slave-2kcd"
server_key: "bda93e4bd8b20ea9d85c3f73c7fa9d2e"
server_key_iv: "371c492615bf0a976ac1973664677223"
server_key_version: "encryptionkey@0"
I20260806 20:37:24.839043 17685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/wal/instance:
uuid: "ca732f0c9d734110a6f3a941f8b28aa0"
format_stamp: "Formatted at 2026-08-06 20:37:24 on dist-test-slave-2kcd"
server_key: "bda93e4bd8b20ea9d85c3f73c7fa9d2e"
server_key_iv: "371c492615bf0a976ac1973664677223"
server_key_version: "encryptionkey@0"
I20260806 20:37:24.844333 17685 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 20:37:24.847849 17704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:24.849424 17685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 20:37:24.849617 17685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/wal
uuid: "ca732f0c9d734110a6f3a941f8b28aa0"
format_stamp: "Formatted at 2026-08-06 20:37:24 on dist-test-slave-2kcd"
server_key: "bda93e4bd8b20ea9d85c3f73c7fa9d2e"
server_key_iv: "371c492615bf0a976ac1973664677223"
server_key_version: "encryptionkey@0"
I20260806 20:37:24.849845 17685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:24.887764 17685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:24.892453 17685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:24.892764 17685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:24.912199 17685 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.126:39489
I20260806 20:37:24.912221 17782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.126:39489 every 8 connection(s)
I20260806 20:37:24.913607 17685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/data/info.pb
I20260806 20:37:24.917311 17789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:24.922204 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17685
I20260806 20:37:24.922442 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-0/wal/instance
I20260806 20:37:24.922899 13909 external_mini_cluster.cc:1428] Setting key 97831461f2982483f2761559edd0b704
I20260806 20:37:24.923908 17789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:24 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:24.947986 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:24.927026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39489 (local address 127.0.0.1:56336)
0806 20:37:24.928246 (+ 1220us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:24.928291 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:24.930118 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:24.930948 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:24.930954 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:24.931663 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:24.932013 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:24.932030 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:24.933698 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:24.933707 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:24.934770 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:24.934783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:24.935713 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:24.935720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:24.935907 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:24.936583 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:24.936606 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:24.939226 (+ 2620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:24.943730 (+ 4504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:24.943740 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:24.943749 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:24.944183 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:24.944678 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:24.944681 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:24.944683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:24.944933 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:24.946040 (+ 1107us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:24.946046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:24.946267 (+ 221us) client_negotiation.cc:769] Sending connection context
0806 20:37:24.946484 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 20:37:24.946882 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"thread_start_us":794,"threads_started":1}
I20260806 20:37:24.948007 17794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:24.927025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56336 (local address 127.13.149.126:39489)
0806 20:37:24.927951 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:24.927971 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:24.928419 (+ 448us) server_negotiation.cc:407] Connection header received
0806 20:37:24.930475 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:24.930481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:24.930713 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:24.930917 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:24.932232 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:24.933534 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:24.934914 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:24.935465 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:24.935680 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:24.939476 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:24.939489 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:24.939515 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:24.939565 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:24.943582 (+ 4017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:24.944327 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:24.944338 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:24.944344 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:24.944557 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:24.945050 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:24.945058 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:24.945063 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:24.945855 (+ 792us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:24.946078 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:24.946692 (+ 614us) server_negotiation.cc:299] Negotiation successful
0806 20:37:24.947101 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":685,"spinlock_wait_cycles":35584,"thread_start_us":489,"threads_started":1}
I20260806 20:37:24.951224 17789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:24.952373 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:24.951943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50588)
0806 20:37:24.952144 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:24.952252 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260806 20:37:24.952672 17713 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
I20260806 20:37:24.954421 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:24.953984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50598)
0806 20:37:24.954169 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:24.954295 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260806 20:37:24.954655 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46117: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.13.149.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab.
Entry for principal kudu/127.13.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab.
I20260806 20:37:24.998140 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:46117
--webserver_interface=127.13.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab
--principal=kudu/127.13.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:39489,127.13.149.125:46117,127.13.149.124:46231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:37:25.004010 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } attempt: 1
I20260806 20:37:25.005208 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.004717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50610)
0806 20:37:25.004953 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.005064 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260806 20:37:25.006413 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.006027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50616)
0806 20:37:25.006200 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.006275 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 20:37:25.006654 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46117: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
I20260806 20:37:25.074941 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } attempt: 2
I20260806 20:37:25.076216 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.075677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50622)
0806 20:37:25.075965 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.076061 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 20:37:25.077333 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.076960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50624)
0806 20:37:25.077112 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.077203 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 20:37:25.077574 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46117: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
I20260806 20:37:25.169011 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } attempt: 3
I20260806 20:37:25.170328 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.169733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50628)
0806 20:37:25.169994 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.170128 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260806 20:37:25.171510 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.171061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50632)
0806 20:37:25.171239 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.171327 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 20:37:25.171736 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46117: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
I20260806 20:37:25.315008 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } attempt: 4
I20260806 20:37:25.316447 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.315735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50638)
0806 20:37:25.316082 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.316238 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260806 20:37:25.317577 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.317126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50650)
0806 20:37:25.317290 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.317418 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 20:37:25.317845 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.125:46117: Network error: Client connection negotiation failed: client connection to 127.13.149.125:46117: connect: Connection refused (error 111)
W20260806 20:37:25.341966 17801 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 20:37:25.342300 17801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:25.342412 17801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:25.342577 17801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:25.349934 17801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:25.350016 17801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:25.350119 17801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:25.350195 17801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:25.350304 17801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:25.360204 17801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:39489,127.13.149.125:46117,127.13.149.124:46231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.125.keytab
--principal=kudu/127.13.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.125:46117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:25.361533 17801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:25.362835 17801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:25.375041 17810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:25.374984 17812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:25.375447 17809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:25.376176 17801 server_base.cc:1034] running on GCE node
I20260806 20:37:25.376921 17801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:25.378194 17801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:25.379405 17801 hybrid_clock.cc:648] HybridClock initialized: now 1786048645379317 us; error 58 us; skew 500 ppm
I20260806 20:37:25.379666 17801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:25 dist-test-slave-2kcd krb5kdc[17661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:25.383278 17801 init.cc:377] Logged in from keytab as kudu/127.13.149.125@KRBTEST.COM (short username kudu)
I20260806 20:37:25.384730 17801 webserver.cc:460] Webserver started at http://127.13.149.125:40943/ using document root <none> and password file <none>
I20260806 20:37:25.385509 17801 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:25.385598 17801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:25.385844 17801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:25.388728 17801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data/instance:
uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9"
format_stamp: "Formatted at 2026-08-06 20:37:25 on dist-test-slave-2kcd"
server_key: "f5966835bda2e86268c1d94e75ab9888"
server_key_iv: "035de4ef6a29b9d80486d3223f3b6a95"
server_key_version: "encryptionkey@0"
I20260806 20:37:25.389557 17801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/wal/instance:
uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9"
format_stamp: "Formatted at 2026-08-06 20:37:25 on dist-test-slave-2kcd"
server_key: "f5966835bda2e86268c1d94e75ab9888"
server_key_iv: "035de4ef6a29b9d80486d3223f3b6a95"
server_key_version: "encryptionkey@0"
I20260806 20:37:25.394654 17801 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 20:37:25.398206 17824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:25.399659 17801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 20:37:25.399850 17801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/wal
uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9"
format_stamp: "Formatted at 2026-08-06 20:37:25 on dist-test-slave-2kcd"
server_key: "f5966835bda2e86268c1d94e75ab9888"
server_key_iv: "035de4ef6a29b9d80486d3223f3b6a95"
server_key_version: "encryptionkey@0"
I20260806 20:37:25.400115 17801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:25.425110 17801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:25.429283 17801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:25.429579 17801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:25.449148 17801 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.125:46117
I20260806 20:37:25.449168 17910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.125:46117 every 8 connection(s)
I20260806 20:37:25.450556 17801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/data/info.pb
I20260806 20:37:25.454638 17911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:25.460309 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17801
I20260806 20:37:25.460517 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-1/wal/instance
I20260806 20:37:25.461119 13909 external_mini_cluster.cc:1428] Setting key dfbc421f9788c24842ebf3645f81b2a2
I20260806 20:37:25.461509 17911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:25 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:25.487303 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.464855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56352 (local address 127.13.149.126:39489)
0806 20:37:25.465407 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:25.465415 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:25.466392 (+ 977us) server_negotiation.cc:407] Connection header received
0806 20:37:25.469359 (+ 2967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:25.469364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:25.469434 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:25.469534 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:25.471754 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.472463 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.475063 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.475480 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.475599 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:25.479531 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:25.479541 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:25.479549 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:25.479608 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:25.483516 (+ 3908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:25.484297 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:25.484306 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:25.484312 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:25.484507 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:25.485125 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:25.485133 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:25.485139 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:25.485571 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:25.485728 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:25.486554 (+ 826us) server_negotiation.cc:299] Negotiation successful
0806 20:37:25.486809 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":248,"threads_started":1}
I20260806 20:37:25.488010 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.465394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39489 (local address 127.0.0.1:56352)
0806 20:37:25.466191 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.466245 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:25.469028 (+ 2783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:25.469823 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:25.469837 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:25.470673 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:25.471497 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:25.471526 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.472656 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.472665 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:25.474814 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:25.474834 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.475737 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.475747 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:25.476086 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:25.476862 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:25.476897 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:25.479279 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:25.483674 (+ 4395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:25.483680 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:25.483694 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:25.484156 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:25.484672 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:25.484677 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:25.484679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:25.484985 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:25.485715 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:25.485721 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:25.486125 (+ 404us) client_negotiation.cc:769] Sending connection context
0806 20:37:25.486387 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 20:37:25.486794 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":300,"threads_started":1}
I20260806 20:37:25.489908 17911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.149.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.149.124@KRBTEST.COM" created.
Aug 06 20:37:25 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:37:25.507488 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.490907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50656)
0806 20:37:25.491082 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.491112 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:25.491255 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:25.491985 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:25.491989 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:25.492436 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:25.492561 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:25.492569 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.494031 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.494040 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:25.494979 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:25.494992 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.495796 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.495801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:25.496090 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:25.496718 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:25.496735 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:25.501453 (+ 4718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:25.504984 (+ 3531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:25.504989 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:25.504993 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:25.505359 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:25.505728 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:25.505734 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:25.505737 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:25.505880 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:25.506460 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:25.506469 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:25.506601 (+ 132us) client_negotiation.cc:769] Sending connection context
0806 20:37:25.506799 (+ 198us) client_negotiation.cc:240] Negotiation successful
0806 20:37:25.507059 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":55}
I20260806 20:37:25.507522 17919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.490964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50656 (local address 127.13.149.125:46117)
0806 20:37:25.491591 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:25.491596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:25.491620 (+ 24us) server_negotiation.cc:407] Connection header received
0806 20:37:25.491660 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:25.491666 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:25.491837 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:25.491997 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:25.492744 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.493891 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.495118 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.495653 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.495787 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:25.501676 (+ 5889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:25.501687 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:25.501701 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:25.501727 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:25.504823 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:25.505489 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:25.505497 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:25.505501 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:25.505621 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:25.505993 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:25.505998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:25.506001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:25.506335 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:25.506555 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:25.506944 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 20:37:25.507145 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":483,"thread_start_us":310,"threads_started":1}
I20260806 20:37:25.510133 17911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:25.511340 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.510799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42092)
0806 20:37:25.511098 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.511192 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
W20260806 20:37:25.511615 17825 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.513290 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.512816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42096)
0806 20:37:25.513035 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.513141 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260806 20:37:25.513513 17911 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab.
Entry for principal kudu/127.13.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab.
I20260806 20:37:25.537923 13909 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
/tmp/dist-test-taskdNjTCo/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:46231
--webserver_interface=127.13.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab
--principal=kudu/127.13.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.149.84:34915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.149.126:39489,127.13.149.125:46117,127.13.149.124:46231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 20:37:25.562842 17911 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 1
I20260806 20:37:25.564107 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.563633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42110)
0806 20:37:25.563842 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.563945 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260806 20:37:25.565104 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.564749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42124)
0806 20:37:25.564933 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.565004 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 20:37:25.565348 17911 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.617236 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } attempt: 5
Aug 06 20:37:25 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:37:25.632215 17919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.618102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50662 (local address 127.13.149.125:46117)
0806 20:37:25.618285 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:25.618290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:25.618400 (+ 110us) server_negotiation.cc:407] Connection header received
0806 20:37:25.618652 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:25.618660 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:25.618750 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:25.618874 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:25.619902 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.620593 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.622582 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.622996 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.623089 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:25.626839 (+ 3750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:25.626844 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:25.626847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:25.626878 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:25.629600 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:25.630374 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:25.630377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:25.630380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:25.630490 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:25.630925 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:25.630928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:25.630930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:25.631217 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:25.631332 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:25.631773 (+ 441us) server_negotiation.cc:299] Negotiation successful
0806 20:37:25.631934 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:37:25.632328 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.618014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50662)
0806 20:37:25.618273 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.618301 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:25.618460 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:25.618950 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:25.618958 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:25.619461 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:25.619747 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:25.619762 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.620741 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.620749 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:25.622401 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:25.622421 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.623148 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:25.623154 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:25.623408 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:25.624039 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:25.624063 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:25.626639 (+ 2576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:25.629737 (+ 3098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:25.629742 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:25.629746 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:25.630257 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:25.630606 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:25.630613 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:25.630619 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:25.630816 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:25.631347 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:25.631352 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:25.631527 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 20:37:25.631684 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 20:37:25.631983 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 20:37:25.633395 17789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } has no permanent_uuid. Determining permanent_uuid...
I20260806 20:37:25.633591 17911 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 2
I20260806 20:37:25.634498 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.634117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42146)
0806 20:37:25.634304 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.634371 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260806 20:37:25.634519 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.634072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42140)
0806 20:37:25.634262 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.634367 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 20:37:25.635666 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.635149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42168)
0806 20:37:25.635350 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.635479 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 20:37:25.635977 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.637279 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.635107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42162)
0806 20:37:25.637017 (+ 1910us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.637097 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1829,"threads_started":1}
W20260806 20:37:25.637777 17911 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.687227 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 1
I20260806 20:37:25.688426 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.687974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42170)
0806 20:37:25.688170 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.688261 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 20:37:25.689620 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.689305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42184)
0806 20:37:25.689446 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.689509 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 20:37:25.689888 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.729039 17911 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 3
I20260806 20:37:25.730640 17924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.729724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42192)
0806 20:37:25.730030 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.730330 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 20:37:25.731959 17924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.731400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42202)
0806 20:37:25.731688 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.731788 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260806 20:37:25.732250 17911 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.758242 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 2
I20260806 20:37:25.759603 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.759086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42210)
0806 20:37:25.759326 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.759438 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260806 20:37:25.760753 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.760423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42216)
0806 20:37:25.760563 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.760653 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 20:37:25.761034 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.867245 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 3
I20260806 20:37:25.868402 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.867904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42230)
0806 20:37:25.868121 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.868223 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 20:37:25.869592 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.869174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42234)
0806 20:37:25.869403 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.869486 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260806 20:37:25.869801 17789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
I20260806 20:37:25.875489 17911 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 4
I20260806 20:37:25.876650 17924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.876119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42246)
0806 20:37:25.876357 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.876464 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260806 20:37:25.877876 17924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.877465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42254)
0806 20:37:25.877635 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:25.877725 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 20:37:25.878119 17911 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.149.124:46231: Network error: Client connection negotiation failed: client connection to 127.13.149.124:46231: connect: Connection refused (error 111)
W20260806 20:37:25.887449 17923 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 20:37:25.887820 17923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 20:37:25.887907 17923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 20:37:25.887985 17923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 20:37:25.895356 17923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 20:37:25.895490 17923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 20:37:25.895620 17923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 20:37:25.895710 17923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 20:37:25.895823 17923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 20:37:25.906682 17923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.149.84:34915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.149.126:39489,127.13.149.125:46117,127.13.149.124:46231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/krb5kdc/kudu_127.13.149.124.keytab
--principal=kudu/127.13.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.149.124:46231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 19:07:42 UTC on ccycloud.quasar-cuhmbo.root.comops.site
build id 4571034
ASAN enabled
I20260806 20:37:25.908067 17923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 20:37:25.909555 17923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 20:37:25.921613 17935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:25.921526 17936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 20:37:25.921613 17938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 20:37:25.922359 17923 server_base.cc:1034] running on GCE node
I20260806 20:37:25.923096 17923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 20:37:25.924438 17923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 20:37:25.925678 17923 hybrid_clock.cc:648] HybridClock initialized: now 1786048645925597 us; error 46 us; skew 500 ppm
I20260806 20:37:25.926049 17923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 20:37:25 dist-test-slave-2kcd krb5kdc[17661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 20:37:25.929602 17923 init.cc:377] Logged in from keytab as kudu/127.13.149.124@KRBTEST.COM (short username kudu)
I20260806 20:37:25.931080 17923 webserver.cc:460] Webserver started at http://127.13.149.124:36151/ using document root <none> and password file <none>
I20260806 20:37:25.931802 17923 fs_manager.cc:359] Metadata directory not provided
I20260806 20:37:25.931905 17923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 20:37:25.932188 17923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 20:37:25.935344 17923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data/instance:
uuid: "66729dd71dc9460aa00814065f06ac9c"
format_stamp: "Formatted at 2026-08-06 20:37:25 on dist-test-slave-2kcd"
server_key: "c3a1881712d44bf738169e9cc78fcc24"
server_key_iv: "3b4e74d769fb3fc6eca273889a9b9b69"
server_key_version: "encryptionkey@0"
I20260806 20:37:25.936170 17923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/wal/instance:
uuid: "66729dd71dc9460aa00814065f06ac9c"
format_stamp: "Formatted at 2026-08-06 20:37:25 on dist-test-slave-2kcd"
server_key: "c3a1881712d44bf738169e9cc78fcc24"
server_key_iv: "3b4e74d769fb3fc6eca273889a9b9b69"
server_key_version: "encryptionkey@0"
I20260806 20:37:25.941762 17923 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 20:37:25.945363 17949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 20:37:25.946861 17923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 20:37:25.947075 17923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data,/tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/wal
uuid: "66729dd71dc9460aa00814065f06ac9c"
format_stamp: "Formatted at 2026-08-06 20:37:25 on dist-test-slave-2kcd"
server_key: "c3a1881712d44bf738169e9cc78fcc24"
server_key_iv: "3b4e74d769fb3fc6eca273889a9b9b69"
server_key_version: "encryptionkey@0"
I20260806 20:37:25.947314 17923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 20:37:25.962364 17923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 20:37:25.966566 17923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 20:37:25.966842 17923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 20:37:25.986119 17923 rpc_server.cc:307] RPC server started. Bound to: 127.13.149.124:46231
I20260806 20:37:25.986141 18035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.149.124:46231 every 8 connection(s)
I20260806 20:37:25.987511 17923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/data/info.pb
I20260806 20:37:25.989064 13909 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu as pid 17923
I20260806 20:37:25.989286 13909 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdNjTCo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786048265930148-13909-0/minicluster-data/master-2/wal/instance
I20260806 20:37:25.989871 13909 external_mini_cluster.cc:1428] Setting key e98ba23d38fe61dd123cb4b6eda5e60e
I20260806 20:37:25.992293 18036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 20:37:26.000622 18036 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:25 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
Aug 06 20:37:26 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
I20260806 20:37:26.014184 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:25.991745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42268 (local address 127.13.149.124:46231)
0806 20:37:25.992548 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:25.992560 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:25.992602 (+ 42us) server_negotiation.cc:407] Connection header received
0806 20:37:25.994255 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:25.994276 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:25.994646 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:25.994969 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:25.996876 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:25.998210 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.000001 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.000618 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.000752 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.005999 (+ 5247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.006006 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.006016 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.006055 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.009708 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.010393 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.010407 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.010413 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.010587 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.011045 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.011050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.011053 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.011576 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.011916 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.012392 (+ 476us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.012938 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":384,"threads_started":1}
I20260806 20:37:26.020704 18040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.003858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56360 (local address 127.13.149.126:39489)
0806 20:37:26.004409 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.004415 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.005010 (+ 595us) server_negotiation.cc:407] Connection header received
0806 20:37:26.005213 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.005219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.005313 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.005451 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.006585 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.007450 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.009690 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.010099 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.010248 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.013543 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.013550 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.013554 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.013604 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.017623 (+ 4019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.018346 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.018351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.018353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.018520 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.018952 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.018959 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.018963 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.019329 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.019492 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.020071 (+ 579us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.020277 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":253,"threads_started":1}
I20260806 20:37:26.020723 18041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.003821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.126:39489 (local address 127.0.0.1:56360)
0806 20:37:26.004867 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:26.004909 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:26.005079 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:26.005499 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:26.005504 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:26.006133 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:26.006425 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.006437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.007678 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.007684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.009515 (+ 1831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.009546 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.010293 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.010299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.010478 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.011144 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:26.011167 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:26.013342 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:26.017764 (+ 4422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.017777 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.017783 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.018204 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.018696 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.018700 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.018702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.018831 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.019585 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:26.019592 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:26.019768 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 20:37:26.019942 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 20:37:26.020253 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"spinlock_wait_cycles":14208,"thread_start_us":566,"threads_started":1}
I20260806 20:37:26.022094 18036 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:26 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.126@KRBTEST.COM
Aug 06 20:37:26 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
I20260806 20:37:26.032500 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.017256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.13.149.126:39489)
0806 20:37:26.018062 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.018066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.018085 (+ 19us) server_negotiation.cc:407] Connection header received
0806 20:37:26.018124 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.018128 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.018178 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.018299 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.019581 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.020409 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.021974 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.022505 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.022647 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.026671 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.026676 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.026680 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.026707 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.029579 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.030334 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.030341 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.030344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.030466 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.030911 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.030916 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.030919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.031296 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.031592 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.031830 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.032053 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":443,"threads_started":1}
I20260806 20:37:26.035398 18041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.022751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.125:46117 (local address 127.0.0.1:50678)
0806 20:37:26.022893 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:26.022912 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:26.023004 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:26.023379 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:26.023383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:26.023738 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:26.023869 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.023877 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.024844 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.024849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.025689 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.025700 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.026476 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.026482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.026667 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.027174 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:26.027190 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:26.029071 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:26.032543 (+ 3472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.032546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.032549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.033107 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.033483 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.033489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.033493 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.033684 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.034432 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:26.034440 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:26.034623 (+ 183us) client_negotiation.cc:769] Sending connection context
0806 20:37:26.034784 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 20:37:26.035066 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 20:37:26.035579 17919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.022892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50678 (local address 127.13.149.125:46117)
0806 20:37:26.023097 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.023103 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.023119 (+ 16us) server_negotiation.cc:407] Connection header received
0806 20:37:26.023178 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.023182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.023238 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.023347 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.024025 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.024672 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.025904 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.026319 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.026460 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.029257 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.029262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.029265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.029296 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.032407 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.033227 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.033231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.033233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.033361 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.033828 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.033832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.033835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.034213 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.034364 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.034905 (+ 541us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.035131 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 20:37:26.036422 18036 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 20:37:26 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.149.125@KRBTEST.COM
Aug 06 20:37:26 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.124@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
I20260806 20:37:26.047024 17789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 4
I20260806 20:37:26.051059 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.034334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50684 (local address 127.13.149.125:46117)
0806 20:37:26.034888 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.034895 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.034924 (+ 29us) server_negotiation.cc:407] Connection header received
0806 20:37:26.034964 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.034968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.035020 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.035139 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.036962 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.037850 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.039261 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.039676 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.039765 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.044756 (+ 4991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.044765 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.044771 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.044840 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.048091 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.048939 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.048946 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.048951 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.049096 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.049532 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.049537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.049541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.049806 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.050084 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.050394 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.050621 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":288,"threads_started":1}
I20260806 20:37:26.051111 18041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.037131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42276)
0806 20:37:26.037299 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:26.037316 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:26.037425 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:26.037719 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:26.037723 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:26.038226 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:26.038403 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.038414 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.039348 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.039352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.040503 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.040522 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.041290 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.041298 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.041535 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.042059 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:26.042084 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:26.044692 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:26.048034 (+ 3342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.048038 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.048044 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.048611 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.049096 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.049102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.049106 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.049266 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.050121 (+ 855us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:26.050127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:26.050285 (+ 158us) client_negotiation.cc:769] Sending connection context
0806 20:37:26.050442 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 20:37:26.050738 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 20:37:26.052063 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.037228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.13.149.124:46231)
0806 20:37:26.037376 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.037381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.037398 (+ 17us) server_negotiation.cc:407] Connection header received
0806 20:37:26.037543 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.037547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.037609 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.037701 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.038549 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.039214 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.040654 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.041108 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.041202 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.044932 (+ 3730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.044936 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.044939 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.044967 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.047821 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.048764 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.048768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.048771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.048989 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.049400 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.049405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.049408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.049908 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.050068 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.051516 (+ 1448us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.051737 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":53}
Aug 06 20:37:26 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048644, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.126@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
I20260806 20:37:26.057166 13909 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 20:37:26.058516 18036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: Bootstrap starting.
I20260806 20:37:26.062525 18036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:26.063700 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.047607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42292)
0806 20:37:26.047763 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:26.047788 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:26.047899 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:26.048623 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:26.048629 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:26.049202 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:26.049424 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.049437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.051293 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.051298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.052597 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.052610 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.053638 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.053646 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.053855 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.054447 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:26.054482 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:26.057032 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:26.060506 (+ 3474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.060512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.060516 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.061138 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.061631 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.061642 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.061645 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.061834 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.062529 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:26.062535 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:26.062731 (+ 196us) client_negotiation.cc:769] Sending connection context
0806 20:37:26.062903 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 20:37:26.063220 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 20:37:26.063731 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.047661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42292 (local address 127.13.149.124:46231)
0806 20:37:26.048331 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.048334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.048355 (+ 21us) server_negotiation.cc:407] Connection header received
0806 20:37:26.048390 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.048393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.048447 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.048582 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.049620 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.051131 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.052828 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.053501 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.053690 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.057306 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.057313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.057317 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.057355 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.060363 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.061286 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.061292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.061297 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.061493 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.061971 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.061976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.061979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.062363 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.062518 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.063047 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.063278 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":551,"thread_start_us":315,"threads_started":1}
I20260806 20:37:26.063964 18036 log.cc:824] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:26.060226 17746 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ca732f0c9d734110a6f3a941f8b28aa0"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56364
I20260806 20:37:26.067431 18036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: No bootstrap required, opened a new log
I20260806 20:37:26.069238 17789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0: Bootstrap starting.
I20260806 20:37:26.073035 17789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:26.074258 17789 log.cc:824] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:26.077487 17789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0: No bootstrap required, opened a new log
I20260806 20:37:26.077746 18036 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.078195 18036 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66729dd71dc9460aa00814065f06ac9c, State: Initialized, Role: FOLLOWER
I20260806 20:37:26.078696 18036 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.079649 18049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.080086 18049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:26.080881 18036 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:26.085856 17789 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.086268 17789 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca732f0c9d734110a6f3a941f8b28aa0, State: Initialized, Role: FOLLOWER
I20260806 20:37:26.086753 17789 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.087860 18061 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.088328 18061 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:26.089143 17789 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:26.089241 17746 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 20:37:26.089447 17746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:26.093302 17746 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.096405 17746 leader_election.cc:288] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [CANDIDATE]: Term 1 election: Requested vote from peers a21dd89141f04f0ebe2cb7f1aba32fe9 (127.13.149.125:46117), 66729dd71dc9460aa00814065f06ac9c (127.13.149.124:46231)
I20260806 20:37:26.104015 17992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "66729dd71dc9460aa00814065f06ac9c"
I20260806 20:37:26.104650 17992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [term 0 FOLLOWER]: Advancing to term 1
W20260806 20:37:26.105525 18069 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 20:37:26.105748 18069 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 20:37:26.091964 17923 master_runner.cc:186] Error getting master registration for 127.13.149.126:39489: OK, instance_id { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" instance_seqno: 1786048644906734 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 20:37:26.109591 17923 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 20:37:26.109702 17992 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca732f0c9d734110a6f3a941f8b28aa0 in term 1.
I20260806 20:37:26.110447 17705 leader_election.cc:302] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66729dd71dc9460aa00814065f06ac9c, ca732f0c9d734110a6f3a941f8b28aa0; no voters:
I20260806 20:37:26.111057 18061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 20:37:26.111737 18061 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [term 1 LEADER]: Becoming Leader. State: Replica: ca732f0c9d734110a6f3a941f8b28aa0, State: Running, Role: LEADER
I20260806 20:37:26.112416 18061 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.117765 18085 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca732f0c9d734110a6f3a941f8b28aa0. Latest consensus state: current_term: 1 leader_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.118216 18085 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:26.138237 18096 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 20:37:26.141453 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.114403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56374 (local address 127.13.149.126:39489)
0806 20:37:26.114605 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.114610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.123690 (+ 9080us) server_negotiation.cc:407] Connection header received
0806 20:37:26.123931 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.123939 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.124028 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.124158 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.126259 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.127337 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.129235 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.129680 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.129840 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.133168 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.133176 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.133182 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.133227 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.137436 (+ 4209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.138205 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.138215 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.138220 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.138396 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.138883 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.138891 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.138896 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.139312 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.139608 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.140878 (+ 1270us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.141095 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260806 20:37:26.145987 17715 tablet.cc:2369] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:37:26.155593 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.113986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50690 (local address 127.13.149.125:46117)
0806 20:37:26.114196 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.114203 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.136801 (+ 22598us) server_negotiation.cc:407] Connection header received
0806 20:37:26.138153 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.138160 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.138252 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.138354 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.140350 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.141429 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.143669 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.144349 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.144444 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.147982 (+ 3538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.148000 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.148004 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.148050 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.151823 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.152864 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.152870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.152874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.153051 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.153604 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.153611 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.153614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.154021 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.154349 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.154922 (+ 573us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.155199 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 20:37:26.159219 18106 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 20:37:26.163395 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.141479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.13.149.124:46231)
0806 20:37:26.141694 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.141701 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.142393 (+ 692us) server_negotiation.cc:407] Connection header received
0806 20:37:26.142465 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.142471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.142579 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.142680 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.144450 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.145619 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.150032 (+ 4413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.150809 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.150913 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.156418 (+ 5505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.156425 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.156429 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.156474 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.160124 (+ 3650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.160910 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.160915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.160934 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.161082 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.161513 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.161518 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.161521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.161900 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.162140 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.162693 (+ 553us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.163047 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:37:26.163434 18096 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 20:37:26.177335 17911 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } attempt: 5
I20260806 20:37:26.168671 17685 master_runner.cc:186] Error getting master registration for 127.13.149.125:46117: OK, instance_id { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" instance_seqno: 1786048645443324 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 20:37:26.184288 17685 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 20:37:26 dist-test-slave-2kcd krb5kdc[17661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786048645, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.149.125@KRBTEST.COM for kudu/127.13.149.124@KRBTEST.COM
I20260806 20:37:26.191388 17992 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [term 1 FOLLOWER]: Refusing update from remote peer ca732f0c9d734110a6f3a941f8b28aa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:37:26.192584 18085 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:37:26.209020 17924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.177838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.149.124:46231 (local address 127.0.0.1:42302)
0806 20:37:26.178201 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 20:37:26.178222 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 20:37:26.178332 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 20:37:26.181305 (+ 2973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 20:37:26.181311 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 20:37:26.181919 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0806 20:37:26.182151 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.182164 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.183951 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.183956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.185124 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 20:37:26.185137 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.186217 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.186224 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 20:37:26.186413 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.187130 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 20:37:26.187175 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 20:37:26.192831 (+ 5656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 20:37:26.204589 (+ 11758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.204595 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.204611 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.205187 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.206171 (+ 984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 20:37:26.206176 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 20:37:26.206182 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 20:37:26.206380 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 20:37:26.207742 (+ 1362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 20:37:26.207748 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 20:37:26.207966 (+ 218us) client_negotiation.cc:769] Sending connection context
0806 20:37:26.208107 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 20:37:26.208475 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238}
I20260806 20:37:26.211520 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.178632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42302 (local address 127.13.149.124:46231)
0806 20:37:26.180931 (+ 2299us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.180940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.180960 (+ 20us) server_negotiation.cc:407] Connection header received
0806 20:37:26.181013 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.181018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.181094 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.182372 (+ 1278us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.182520 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.183807 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.185272 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.185998 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.186187 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.193177 (+ 6990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 20:37:26.193219 (+ 42us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 20:37:26.193225 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 20:37:26.193296 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0806 20:37:26.204275 (+ 10979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.205563 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.205568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.205572 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.205956 (+ 384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 20:37:26.206634 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 20:37:26.206639 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 20:37:26.206644 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 20:37:26.207409 (+ 765us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 20:37:26.209872 (+ 2463us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.210161 (+ 289us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.210647 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2186}
I20260806 20:37:26.219163 17911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9: Bootstrap starting.
W20260806 20:37:26.219969 17957 tablet.cc:2369] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 20:37:26.227572 17911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9: Neither blocks nor log segments found. Creating new log.
I20260806 20:37:26.228541 18049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca732f0c9d734110a6f3a941f8b28aa0. Latest consensus state: current_term: 1 leader_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.229405 18049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:26.230219 17911 log.cc:824] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9: Log is configured to *not* fsync() on all Append() calls
I20260806 20:37:26.231536 18109 mvcc.cc:205] Tried to move back new op lower bound from 7315655254788452352 to 7315655254481915904. Current Snapshot: MvccSnapshot[applied={T|T < 7315655254788452352}]
I20260806 20:37:26.242221 18061 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.242589 18061 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:26.244290 18049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.244555 18049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:26.245965 18096 catalog_manager.cc:1347] Generated new cluster ID: dc496aee4a0b440f92633a424f442962
I20260806 20:37:26.246062 18096 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 20:37:26.263069 17911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9: No bootstrap required, opened a new log
I20260806 20:37:26.265648 18096 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 20:37:26.267616 18096 catalog_manager.cc:1504] Loading token signing keys...
I20260806 20:37:26.281656 18096 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0: Generated new TSK 0
I20260806 20:37:26.282963 18096 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 20:37:26.285113 17911 raft_consensus.cc:348] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.285570 17911 raft_consensus.cc:729] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21dd89141f04f0ebe2cb7f1aba32fe9, State: Initialized, Role: FOLLOWER
I20260806 20:37:26.286168 17911 consensus_queue.cc:260] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } }
I20260806 20:37:26.287583 18119 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.288324 18119 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:26.288879 17911 sys_catalog.cc:564] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 20:37:26.289317 17864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 20:37:26.289863 17865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9"
I20260806 20:37:26.294054 17864 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [term 1 FOLLOWER]: Refusing update from remote peer ca732f0c9d734110a6f3a941f8b28aa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 20:37:26.297622 17865 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca732f0c9d734110a6f3a941f8b28aa0 in term 1.
I20260806 20:37:26.300112 18085 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 20:37:26.349084 18119 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca732f0c9d734110a6f3a941f8b28aa0. Latest consensus state: current_term: 1 leader_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.349480 18119 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:26.349084 18142 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.350849 18142 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 20:37:26.379876 18154 catalog_manager.cc:1259] Loaded cluster ID: dc496aee4a0b440f92633a424f442962
I20260806 20:37:26.379989 18154 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9: loading cluster ID for follower catalog manager: success
I20260806 20:37:26.383674 18154 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9: acquiring CA information for follower catalog manager: success
I20260806 20:37:26.386117 18154 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a21dd89141f04f0ebe2cb7f1aba32fe9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 20:37:26.456182 18042 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.443209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56382 (local address 127.13.149.126:39489)
0806 20:37:26.443457 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.443466 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.453699 (+ 10233us) server_negotiation.cc:407] Connection header received
0806 20:37:26.454390 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.454398 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.454508 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.454595 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.455872 (+ 1277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56382: BlockingRecv error: recv got EOF from 127.0.0.1:56382 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260806 20:37:26.458726 18043 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.445414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50700 (local address 127.13.149.125:46117)
0806 20:37:26.445631 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.445638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.457066 (+ 11428us) server_negotiation.cc:407] Connection header received
0806 20:37:26.457287 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.457297 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.457415 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.457488 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.458482 (+ 994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50700: BlockingRecv error: recv got EOF from 127.0.0.1:50700 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 20:37:26.467409 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.464568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42306 (local address 127.13.149.124:46231)
0806 20:37:26.464756 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.464764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.465474 (+ 710us) server_negotiation.cc:407] Connection header received
0806 20:37:26.465759 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.465766 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.465868 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.465946 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.467164 (+ 1218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42306: BlockingRecv error: recv got EOF from 127.0.0.1:42306 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:37:26.539075 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.518663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50702 (local address 127.13.149.125:46117)
0806 20:37:26.518885 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.518891 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.529496 (+ 10605us) server_negotiation.cc:407] Connection header received
0806 20:37:26.529770 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.529777 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.530059 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.530252 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:26.531020 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.532243 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.534421 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.535170 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.535268 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.536342 (+ 1074us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:26.538236 (+ 1894us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:26.538359 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.538607 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.538701 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260806 20:37:26.591936 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.582523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42308 (local address 127.13.149.124:46231)
0806 20:37:26.582748 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.582757 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.589260 (+ 6503us) server_negotiation.cc:407] Connection header received
0806 20:37:26.590176 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.590184 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.590308 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.590426 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.591672 (+ 1246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42308: BlockingRecv error: recv got EOF from 127.0.0.1:42308 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 20:37:26.636041 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.621548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50714 (local address 127.13.149.125:46117)
0806 20:37:26.621750 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.621757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.628704 (+ 6947us) server_negotiation.cc:407] Connection header received
0806 20:37:26.629241 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.629249 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.629355 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.629424 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:26.630126 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.631294 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.633637 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.634371 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.634506 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.635158 (+ 652us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:26.635315 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:26.635378 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.635628 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.635718 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 20:37:26.679297 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.670157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42318 (local address 127.13.149.124:46231)
0806 20:37:26.670407 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.670416 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.677459 (+ 7043us) server_negotiation.cc:407] Connection header received
0806 20:37:26.677734 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.677740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.677842 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.677944 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.679049 (+ 1105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42318: BlockingRecv error: recv got EOF from 127.0.0.1:42318 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 20:37:26.728374 18085 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca732f0c9d734110a6f3a941f8b28aa0" member_type: VOTER last_known_addr { host: "127.13.149.126" port: 39489 } } peers { permanent_uuid: "a21dd89141f04f0ebe2cb7f1aba32fe9" member_type: VOTER last_known_addr { host: "127.13.149.125" port: 46117 } } peers { permanent_uuid: "66729dd71dc9460aa00814065f06ac9c" member_type: VOTER last_known_addr { host: "127.13.149.124" port: 46231 } } }
I20260806 20:37:26.731145 18085 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca732f0c9d734110a6f3a941f8b28aa0 [sys.catalog]: This master's current role is: LEADER
I20260806 20:37:26.744328 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.733244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50716 (local address 127.13.149.125:46117)
0806 20:37:26.733434 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.733440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.737387 (+ 3947us) server_negotiation.cc:407] Connection header received
0806 20:37:26.737864 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.737871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.738004 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.738093 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:26.738805 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.739970 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.742026 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.742692 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.742797 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.743434 (+ 637us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:26.743603 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:26.743675 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.743908 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.744009 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 20:37:26.784226 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.775068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42332 (local address 127.13.149.124:46231)
0806 20:37:26.775314 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.775324 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.782274 (+ 6950us) server_negotiation.cc:407] Connection header received
0806 20:37:26.782602 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.782608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.782716 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.782792 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.783931 (+ 1139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42332: BlockingRecv error: recv got EOF from 127.0.0.1:42332 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 20:37:26.842756 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.831963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50730 (local address 127.13.149.125:46117)
0806 20:37:26.832206 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.832214 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.836535 (+ 4321us) server_negotiation.cc:407] Connection header received
0806 20:37:26.836734 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.836740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.836864 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.836991 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:26.837511 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.838742 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.840676 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.841369 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.841527 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.841999 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:26.842147 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:26.842253 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.842346 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.842438 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
W20260806 20:37:26.850787 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.848545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42336 (local address 127.13.149.124:46231)
0806 20:37:26.848760 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.848764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.849279 (+ 515us) server_negotiation.cc:407] Connection header received
0806 20:37:26.849396 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.849404 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.849519 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.849631 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.850557 (+ 926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42336: BlockingRecv error: recv got EOF from 127.0.0.1:42336 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 20:37:26.868713 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.862654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50744 (local address 127.13.149.125:46117)
0806 20:37:26.862864 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.862871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.863403 (+ 532us) server_negotiation.cc:407] Connection header received
0806 20:37:26.863581 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.863585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.863667 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.863747 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:26.864206 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.865020 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.866938 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.867382 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.867528 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.867944 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:26.868051 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:26.868160 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.868317 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.868410 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 20:37:26.877055 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.875078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42352 (local address 127.13.149.124:46231)
0806 20:37:26.875318 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.875326 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.875624 (+ 298us) server_negotiation.cc:407] Connection header received
0806 20:37:26.875835 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.875840 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.875916 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.876025 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.876807 (+ 782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42352: BlockingRecv error: recv got EOF from 127.0.0.1:42352 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
I20260806 20:37:26.904218 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.897710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50746 (local address 127.13.149.125:46117)
0806 20:37:26.897919 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.897926 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.898487 (+ 561us) server_negotiation.cc:407] Connection header received
0806 20:37:26.898815 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.898824 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.898915 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.899004 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:26.899545 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.900323 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.902337 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.902767 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.902860 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.903410 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:26.903528 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:26.903595 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.903782 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.903867 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 20:37:26.913070 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.910827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.13.149.124:46231)
0806 20:37:26.911097 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.911104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.911505 (+ 401us) server_negotiation.cc:407] Connection header received
0806 20:37:26.911732 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.911737 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.911828 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.911963 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.912865 (+ 902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42364: BlockingRecv error: recv got EOF from 127.0.0.1:42364 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 20:37:26.959394 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:26.952939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50758 (local address 127.13.149.125:46117)
0806 20:37:26.953256 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.953265 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.953824 (+ 559us) server_negotiation.cc:407] Connection header received
0806 20:37:26.954049 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.954054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.954128 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.954211 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:26.954880 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.955690 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.957586 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:26.958024 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:26.958123 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:26.958609 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:26.958728 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:26.958795 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:26.958974 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 20:37:26.959041 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260806 20:37:26.967725 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:26.965576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42370 (local address 127.13.149.124:46231)
0806 20:37:26.965773 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:26.965781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:26.966168 (+ 387us) server_negotiation.cc:407] Connection header received
0806 20:37:26.966392 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:26.966397 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:26.966473 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:26.966583 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:26.967465 (+ 882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42370: BlockingRecv error: recv got EOF from 127.0.0.1:42370 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 20:37:27.041301 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:27.036154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50762 (local address 127.13.149.125:46117)
0806 20:37:27.036429 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:27.036435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:27.036621 (+ 186us) server_negotiation.cc:407] Connection header received
0806 20:37:27.036873 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:27.036879 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:27.036954 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:27.037058 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:27.037496 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.038231 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.039570 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.040011 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.040177 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:27.040549 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:27.040661 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:27.040759 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:27.040938 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 20:37:27.041021 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
W20260806 20:37:27.049012 18044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 20:37:27.047168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42374 (local address 127.13.149.124:46231)
0806 20:37:27.047425 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:27.047432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:27.047624 (+ 192us) server_negotiation.cc:407] Connection header received
0806 20:37:27.047838 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:27.047842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:27.047921 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:27.048030 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 20:37:27.048834 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42374: BlockingRecv error: recv got EOF from 127.0.0.1:42374 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 20:37:27.107724 18069 catalog_manager.cc:1259] Loaded cluster ID: dc496aee4a0b440f92633a424f442962
I20260806 20:37:27.107831 18069 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: loading cluster ID for follower catalog manager: success
I20260806 20:37:27.110405 18069 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: acquiring CA information for follower catalog manager: success
I20260806 20:37:27.112140 18069 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 66729dd71dc9460aa00814065f06ac9c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 20:37:27.186211 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:27.181046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.13.149.125:46117)
0806 20:37:27.181287 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:27.181295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:27.181657 (+ 362us) server_negotiation.cc:407] Connection header received
0806 20:37:27.181887 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:27.181893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:27.181964 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:27.182056 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:27.182473 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.183146 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.184435 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.184888 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.184976 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:27.185436 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:27.185538 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:27.185610 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:27.185796 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 20:37:27.185871 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 20:37:27.198297 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:27.192410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.13.149.124:46231)
0806 20:37:27.192596 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:27.192600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:27.193048 (+ 448us) server_negotiation.cc:407] Connection header received
0806 20:37:27.193221 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:27.193225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:27.193381 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:27.193482 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:27.193945 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.194663 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.195991 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.196389 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.196479 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:27.197151 (+ 672us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:27.197681 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:27.197808 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:27.197987 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 20:37:27.198054 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 20:37:27.216892 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:27.204217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50772 (local address 127.13.149.125:46117)
0806 20:37:27.204459 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:27.204468 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:27.210585 (+ 6117us) server_negotiation.cc:407] Connection header received
0806 20:37:27.210762 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:27.210768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:27.210882 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:27.211002 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:27.211849 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.212929 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.214837 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.215307 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.215429 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:27.215988 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:27.216120 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:27.216190 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:27.216403 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 20:37:27.216497 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 20:37:27.217420 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:27.205222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42388 (local address 127.13.149.124:46231)
0806 20:37:27.205459 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:27.205468 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:27.210159 (+ 4691us) server_negotiation.cc:407] Connection header received
0806 20:37:27.210470 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:27.210475 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:27.210596 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:27.210719 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:27.211773 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.212907 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.215276 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.215837 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.215979 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:27.216498 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:27.216664 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:27.216739 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:27.217021 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 20:37:27.217106 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 20:37:27.218684 18313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 20:37:27.204096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56392 (local address 127.13.149.126:39489)
0806 20:37:27.210124 (+ 6028us) server_negotiation.cc:206] Beginning negotiation
0806 20:37:27.210131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 20:37:27.210157 (+ 26us) server_negotiation.cc:407] Connection header received
0806 20:37:27.210301 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 20:37:27.210309 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 20:37:27.210580 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 20:37:27.210809 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 20:37:27.211538 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.212478 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.214963 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 20:37:27.215654 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 20:37:27.215798 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 20:37:27.216913 (+ 1115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 20:37:27.217401 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 20:37:27.217523 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 20:37:27.218266 (+ 743us) server_negotiation.cc:299] Negotiation successful
0806 20:37:27.218354 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5891,"thread_start_us":5789,"threads_started":1}
I20260806 20:37:27.224391 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17685
I20260806 20:37:27.225561 17777 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:27.336408 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17685
W20260806 20:37:27.368131 17955 connection.cc:535] server connection from 127.0.0.1:42292 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 20:37:27.368746 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17801
I20260806 20:37:27.369938 17905 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:27.477751 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17801
I20260806 20:37:27.509642 13909 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu pid 17923
I20260806 20:37:27.510823 18022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 20:37:27.617128 13909 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdNjTCo/build/asan/bin/kudu with pid 17923
2026-08-06T20:37:27Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4879 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9760 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (381656 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST